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ABSTRACT: 

There is provided an information processing apparatus which may be applied to an information 
processing apparatus being connected, for example, to an information network such as Internet 
(2) for transmitting and receiving various pieces of information in order to make access to such 
network through a terminal (4, 5, 6, 15) of simplified structure such as a telephone terminal (5). A 
code for uniquely identifying, for example, a telephone terminal (5) and a computer terminal (4) 
may be formed with the codes corresponding to operators of a telephone terminal (5). 
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(57) There is provided an information processing 
apparatus which may be applied to an information 
processing apparatus being connected, for example, to 
an information network such as Internet (2) for transmit- 
ting and receiving various pieces of information in order 
to make access to such network through a terminal (4. 



5. 6. 15) of simplified structure such as a telephone ter- 
minal (5). A code for uniquely identifying, for example, a 
telephone terminal (5) and a computer terminal (4) may 
be formed with the codes corresponding to operators of 
a telephone terminal (5). 
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Description 

BACKGROUND OF THE INVENTION 

Field of the Invention s 

The present invention relates to a processing infor- 
mation which may be adopted, for example, to a server 
of information network such as internet, etc. for enabling 
access to such information networks with terminals of 10 
simplified structure by forming an identification code to 
uniquely identify telephone terminals and computer ter- 
minals, etc. using the codes corresponding to an opera- 
tor of a telephone terminal. 

15 

Description of Related Art 

An information network such as the internet is 
caused to offer various pieces of information assuming 
accesses from computers. 20 

Namely, in the internet, access can be made to the 
World Wide Web (WWW) by expressing protocol and 
host name, etc. in the access format consisting of URL 
(Uniform Resource Locator). Moreover, in the electronic 
mails, a mail address can be generated, in the same 25 
manner, by expressing user name and domain name 
with the predetermined expression format. 

In such an information format, it has been dis- 
cussed, in order to expand the possible services, to 
transmit electronic mails even to facsimile apparatus 30 
and pager, etc. and, in addition, it has been made pos- 
sible in a certain provider to transmit electronic mails 
through speech synthesis. 

If a variety of information can be obtained by mak- 
ing access to the information network of this type 35 
explained above from a telephone terminal, the network 
of this type can be utilized more effectively. However, 
the information network of this type requires keyboard 
operation by a user because it is assumed to make 
access from a computer. Namely, this information net- 40 
work has a problem that the necessary information can- 
not be identified without operation of the keyboard. 
Thereby, it has been difficult to make access to such 
type of information from certain types of telephone ter- 
minals 46 

A service by speech synthesis which is partially uti- 
lized is only a local service on the internet by the 
restricted providers and it is now impossible to enjoy the 
services of the information except for electronic mails 
Moreover, the services for facsimile apparatus and so 
pager which are now discussed in a part of this field is 
only the one which may be realized by the internet in 
place of the current telephone network 

SUMMARY OF THE INVENTION 55 

With the background explained above, the present 
invention is intended to provide an information process- 
ing apparatus which can offer various kinds of services 



by making access to the information network, for exam- 
ple, from telephone terminals. 

In order to solve such problems, the present inven- 
tion generates the identification code required for trans- 
mission and reception of information in the network by 
combining the codes corresponding to operators oper- 
ated in the telephone terminals. 

Corresponding to this identification code or without 
relation to this identification code, an management data 
base having registered information of information origi- 
nation terminal or information destination terminal is 
generated to changeover the information transmission 
and reception processes. 

Moreover, in the information processing apparatus 
for transmitting information such as electronic mail or in 
the information processing apparatus for holding organ- 
ically incorporated various pieces of input information, 
data is transmitted through data conversion due to 
selection of the information origination terminal and 
moreover an input information is totally or partially con- 
verted at the time of inputting or outputting information 
to/from an information storing means. 

In addition, in such an information processing appa- 
ratus, information is transmitted through addition of an 
address code formed of the identification code and an 
input information classification information is also 
added. In the case of the information transmission by 
the voice signal, amount of data after data conversion is 
notified to a charging system. 

Moreover, in the information processing apparatus 
of this type, while access is made to the information 
accumulated in the information storing means, informa- 
tion stored separately is offered to terminal units and 
thereby information can be offered by voices. 

Furthermore, information itself is formed through, 
addition of the control code for identifying the part which 
is output by speech synthesis and the part which is out- 
put by text. 

Formation of the identification code required for 
transmission and reception of information in the infor- 
mation network through combination of codes corre- 
sponding to operators operated in a telephone terminal 
enables reception of information services through 
access to the information network from a telephone ter- 
minal. 

In addition, data conversion and transfer services, 
for example, may be offered by forming an management 
database corresponding to or without relation to the 
identification code and then changing over the informa- 
tion transmission and reception processes. 

Namely, in the information processing apparatus for 
transmitting information such as electronic mails or in 
the information processing apparatus for holding organ- 
ically incorporated various pieces of input information, 
the information of this kind may be input or output, for 
example, from a telephone terminal through data con- 
version. 

In more practical, the information transfer service 
may be implemented by transmitting information with 
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addition of address code including the identification 
code, the corresponding data conversion process may 
be implemented by addition of the input information 
classification information and when the voice signal is 
transmitted, a share of users may be eased by notifying 
amount of data after data conversion to a charging sys- 
tem. 

Moreover, various pieces of information may be 
offered through effective use of connection waiting time 
by offering the information stored separately to the ter- 
minal units while the access is being made to the infor- 
mation stored in the information storing means. In 
addition, such information may also he offered by voices 
for further convenience. 

Further, the information of this type can easily be 
generated by forming the information itself with addition 
of a control code for identifying the part output through 
speech synthesis and the other part. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Other objects and advantages of the present inven- 
tion will be apparent from the following detailed descrip- 
tion of the presently preferred embodiments thereof, 
which description should he considered in conjunction 
with the accompanying drawings in which: 

Fig. 1 is a block diagram illustrating a server in the 
information network in relation to a preferred 
embodiment of the present invention; 
Fig. 2 is a schematic diagram illustrating the net- 
work to which the server of Fig. 1 is adopted; 
Fig. 3 is a table indicating the basic Gaia codes; 
Fig. 4 is a table indicating the attribute codes of Fig. 
3; 

Figs. 5A to 5D are diagrams offered to explain the 
encoding of the Gaia codes; 
Rgs. 6A to 6C are diagrams indicating the encoded 
Gaia codes; 

Fig. 7 is a table indicating a server index of Fig. 3; 
Fig. 8 is a diagram offered to explain the server 
index of Fig. 7; 

Fig. 9 is a table indicating various pieces of informa- 
tion expressed by the Gaia codes; 
Fig. 10 is a table indicating actual various pieces of 
information of Fig. 9; 

Fig. 11 is a diagram illustrating relationship 
between a Gaia server and a MAM server; 
Rg. 12 is a block diagram illustrating relationship of 
Fig. 1 1 with the total system; 
Rg. 13 is a table indicating a user information man- 
agement database; 

Rg. 14 is a table indicating the Gaia code incorpo- 
ration table of the user information management 
database of Rg. 13; 

Rg. 15 is a table indicating the user information 
database of the user information management 
database of Rg. 13; 

Rg. 16 is a diagram illustrating user data of Rg. 15; 
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Rg. 17 is a diagram illustrating non-terminal data of 
Rg. 15; 

Rg. 18 is a diagram illustrating terminal data of Rg. 
15; 

s Rg. 19 is a flowchart offered to explain the setting 
updating process in the table of Fig. 15; 
Rg. 20 is a flowchart offered to explain reference to 
the table of Fig. 15; 

Rgs. 21 A and 21 B are flowcharts offered to explain 

10 transmission of an electronic mail ; 

Rg. 22 is a schematic diagram showing the com- 
munication sequence in Rgs. 21 A and 21B; 
Rg. 23 is a schematic diagram shewing continuous 
communication sequence of Rg. 22; 

is Rgs. 24A and 24B are flowcharts offered to explain 
destination input in Figs. 21 A and 21 B; 
Rgs. 25A and 25B are flowcharts offered to explain 
subject input in Figs. 21 A and 21 B; 
Rgs. 26A and 26B are flowcharts offered to explain 

20 content input in Figs. 21 A and 21 B; 

Rgs. 27A and 27B are flowcharts offered to explain 
destination input by voice recognition; 
Rg. 28 is a schematic diagram showing communi- 
cation sequence of Figs. 27A and 27B; 

25 Rg. 29 is a schematic diagram showing continuous 
sequence of Fig. 28; 

Rg. 30 is a flowchart offered to explain interim 

change of destination input method; 

Rg. 31 is a flowchart showing processing sequence 

30 of a server in Fig. 30; 

Rg. 32 is a schematic diagram indicating communi- 
cation sequence in Fig. 30 and Fig. 31 ; 
Rgs. 33A and 33B are flowcharts offered to explain 
input of contents by selecting a formatted sentence 

35 or free sentence; 

Rgs. 34A and 34B are schematic diagrams indicat- 
ing continuation of Figs. 33A and 33B; 
Rg. 35 is a schematic diagram indicating communi- 
cation sequence of Rgs. 33A and 33B and Figs. 

40 34A and 34B; 

Rg. 36 is a schematic diagram indicating communi- 
cation sequence for inputting the contents with a 
free sentence in Rg. 33 and Fig. 34; 
Rg& 37A and 37B are flowcharts offered to explain 

45 input of contents with a facsimile apparatus; 

Rg. 38 is a flowchart offered to explain services 
with a MAM server; 

Rg. 39 is a flowchart offered to explain user identi- 
fication; 

so Rg. 40 is a flowchart offered to explain notification 
of the number of electronic mails; 
Rg. 41 is a flowchart offered to explain services of 
electronic mail; 

Rg. 42 is a flowchart offered to explain retrieval of 
55 electronic mails by voice recognition; 

Rg. 43 is a flowchart offered to explain retrieval of 
electronic mails by the number of characters; 
Rg. 44 is a flowchart offered to explain retrieval of 
electronic mails by communication partner; 
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Fig. 45 is a flowchart offered to explain retrieval of 

electronic mails by an urgent keyword; 

Fig. 46 is a flowchart offered to explain retrieval of 

electronic mails by keywords classified for each 

type; s 

Fig. 47 is a flowchart offered to explain reading of 

subjects; 

Fig. 48 is a flowchart offered to explain reading of 
English subjects; 

Fig. 49 is a flowchart offered to explain reading of w 

subjects by language identification fuction; 

Fig. 50 is a flowchart offered to explain reading of a 

message; 

Fig. 51 is a table indicating sources of extended 

HTML format; 15 

Fig. 52 is a continuous table of Fig. 51 ; 

Fig. 53 is a flowchart showing access to the home 

page by an ordinary WWW browser; 

Fig. 54 is a diagram showing the processing results 

of sources shown in Fig. 51 and Fig. 52 by the 20 

processing of Fig. 53; 

Fig. 55 is a flowchart showing a processing 
sequence by an exclusive server holding a browser 
to appreciate the sources of Fig. 51 and Fig. 52; 
Fig. 56 is a diagram showing the processing results 25 
of sources shown in Fig. 51 and Fig. 52 by the 
processing of Fig. 55; 

Fig. 57 is a diagram showing objects of voice recog- 
nition by the processing of Fig. 56; 
Fig. 58 is a flowchart showing navigation for linking 30 
destination by voice recognition in the server 1 ; 
Fig. 59 is a flowchart showing a processing 
sequence of navigation for linking destination with a 
DTMF signal; 

Fig. 60 is a diagram indicating the guide to the link- 35 
ing destination by the processing of Fig. 59; 
Fig. 61 is a flowchart showing a communication 
sequence for registration of messages in the mes- 
sage service; 

Fig. 62 is a flowchart showing continuous sequence 40 
of Fig. 61; 

Figs. 63A and 63B are flowcharts showing a 
processing sequence for making access to con- 
tents of message dial; 

Fig. 64 is a flowchart showing a communication 45 
sequence of Figs. 63A and 63B; 
Fig. 65 is a flowchart showing continuous sequence 
of Fig. 64; 

Figs. 66A and 66B are flowcharts showing a 

processing sequence for registration of image data so 

by a facsimile apparatus 6; 

Fig. 67 is a flowchart showing a communication 

sequence of Figs. 66A and 66B; 

Fig. 68 is a flowchart showing continuous sequence 

of Figs. 66A and 66B; ss 

Fig. 69 is a block diagram illustrating peripheral 

structure of the server 1 ; 

Fig. 70 is a flowchart showing the book mark regis- 
tration service when a user has made access from 



a telephone terminal; 

Rg. 71 is a flowchart showing the book mark regis- 
tration processing by a facsimile apparatus; 
Rg. 72 is a flowchart showing a processing 
sequence of the book mark processing when 
access is made to the selected service by voice; 
Rg. 73 is a flowchart showing a processing 
sequence of charging service; 
Rg. 74 is a flowchart showing continuous sequence 
of Rg. 73; and 

Rg. 75 is a table offered to explain the other input 
method. 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

The preferred embodiments of the present inven- 
tion will be explained in detail with reference to the 
accompanying drawings. 

(1) Total structure 

Rg. 1 is a block diagram illustrating a server of the 
information network depending on the preferred embod- 
iments of the present invention. This server 1 is capable 
of making communication with a user terminal via the 
telephone network and also with the other server via the 
internet 2 as required. Thereby, this server 1 can offer 
various kinds of services in addition to the services 
offered by the ordinary internet server, in response to 
the request from user terminals. 

Namely, the telephone network connecting means 
3 receives voice signal, voice data, image data through 
a facsimile apparatus, pager data, DTMF (Dual Tone 
Multi-Frequency) signal via the telephone network and 
also executes the encoding, decoding, error correcting 
operation and dial pulse transmission and reception in 
accordance with transmission and reception of such 
signals and data. Thereby, the server 1 is formed to 
offer, to a computer, various services through the com- 
munication like ordinary personal computer communi- 
cation and also to offer various services to the 
telephone terminal 5, facsimile apparatus 6, private ter- 
minal 1 5 and pager by detecting operations of the oper- 
ators in these terminal units. Here, the private terminal 
15 the exclusive terminal of this server 1 , namely the liq- 
uid crystal display panel for displaying text data, image 
data and image data transmitted from the telephone 
network connecting means 3, transceiver for inputting 
and outputting voice and radio telephone terminal hav- 
ing an operator corresponding to the telephone termi- 
nal. 

Meanwhile, the internet connecting means 7 forms 
a connecting means between the internet 2 and this 
server 1 to transmit and receive the data, for example, of 
electronic mails, FTP (File Transfer Protocol) and HTTP 
(Hyper Text Transfer Protocol) via the internet 2. 

A data format converting means 8 is controlled by a 
central processing means 9 depending on the user 
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request to change over the operation, outputs the voice 
data obtained via the telephone network connecting 
means 3 and image data of the facsimile apparatus 
obtained via the telephone network connecting means 3 
to the internet connecting means 7 after these are con- 
verted to the data on the internet and also outputs in 
turn the data obtained via the internet connecting 
means 7 after it is converted to the voice signal, etc. to 
be applied to the telephone network. In this data conver- 
sion, a data format converting means 8 transmits the 
address code of these data using the Gaia code 
explained later and also transmits the address code 
which identifies the server and contents of server. On 
the contrary, when data depending on the Gaia code is 
received, this data is converted to the original format as 
required. In addition, for the transmission and reception 
of this Gaia code, the data format converting means 8 
transmits or receives this Gaia code through data com- 
pression. 

A central processing means 9 controls the total 
operations of the server 1 to offer various services 
depending on the keying operations at the computer 4, 
telephone terminal 5, facsimile apparatus 6 and private 
terminal 15. In addition, in this case, the central 
processing means 9 discriminates a type of a terminal 
unit connected to the telephone network connecting 
means 3 depending on type of telephone line connected 
to the telephone network connecting means 3, data 
exchange when communication is started between the 
terminal and telephone network connecting means 3 
and format of input data input via the telephone network 
connecting means 3 and offers various services by the 
data format fitted to the terminal depending on this dis- 
crimination result 

Namely, a terminal can be identified from the origi- 
nator number when the communication is started for the 
access by means of the ISDN (Integrated Services Dig- 
ital Network), or from the ceil number to which a hand- 
held telephone set belongs for the access by means of 
the hand-held telephone set or from the header added 
at the leading edge of the image data for the access by 
means of the facsimile apparatus. 

A voice recognition means 10 is controlled by the 
central processing means 9 to change over the opera- 
tion in order to execute voice recognition for the voice 
signal input via the internet connecting means 7 and 
voice signal recorded in a recording and reproducing 
means 12 and convert these voice signals into address 
data, text data, etc. Thereby, the server 1 can make 
access to various pieces of information using the voice 
signal via the telephone terminal 5, a telephone terminal 
incorporated to the facsimile apparatus 6 and private 
terminal 15 and can originate by voice the electronic 
mail in the text data format. 

A speech synthesis means 1 1 executes the speech 
synthesis process for the data input via the internet con- 
necting means 7 and the data stored in an external 
memory 13 to output the voice signal. This voice signal 
is output as required to he telephone network connect- 
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ing means 3 and internet connecting means 7. Thereby, 
the server 1 can offer various services by voice and also 
offer the service of reading by voice the electronic mail 
in the form of the text data. 

s A recording and reproducing means 12 records the 
voice signal input via the internet connecting means 7 
and telephone network connecting means 3 and repro- 
duces and outputs the voice signal in response to the 
user request Thereby, the server 1 can offer so-called 

10 the message dial service and voice guide service. 

A character recognizing means 14 inputs an image 
data of facsimile apparatus and image data of bit map 
format or JPEG (Joint Photographic Experts Group) for- 
mat via the telephone network connecting means 3, 

75 executes character recognition process for the image 
formed from these data and thereby converts these 
image data into the text data. Thereby, the server 1 can 
make access to various pieces of information by means 
of the facsimile apparatus 6 and transmit an electronic 

20 mail by means of the facsimile apparatus 6. 

An image combining means 16 converts, on the 
contrary to the character recognizing means 14 
explained above, the test data into an image data of the 
facsimile apparatus. Thereby, the server 1 is designed 

25 to originate various pieces of information such as an 
electronic mail to the facsimile apparatus 6. Thereby, 
the server 1 is capable of transmitting or receiving infor- 
mation to or from vairous terminals, such as output of 
electronic mail by the voice signal to the facsimile appa- 

30 ratus 6, by combining mutual data conversion proc- 
esses centered on the test data among the voice 
recognizing means 10, speech synthesis means 11, 
character recognition means 14 and image combining 
means 16. 

35 An external memory apparatus 13 stores various 
kinds of information required for operation of the server 
1 such as entry information management and spool 
management of electronic mails. Therefore, the server 1 
is designed to form the Gaia server and MAM server by 

40 means of the server program in this central processing 
means 9, while the external memory apparatus 13 also 
forms the database by these servers. 

A printer 17 is controlled by the central processing 
means 9 to print out addresses and contents of elec- 

45 trorric mails. Thereby, the server 1 can distribute the 
electronic mails by mail. The server 1 is also connected 
a charging system and local service server which will be 
explained later to offer various kinds of services. 

so (2) Gaia code 

The server 1 forms the identification code required 
for transmission and reception of information on the 
internet by combination of codes corresponding to the 
55 operators to be operated in the telephone terminals. 
Hereinafter, the identification code due to combination 
of these codes is called the Gaia code. The operable 
operators are composed of the operators of numerals 
"0" to M 9 W and the operators of signs "* w and "#". Thereby, 
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the server 1 can input the identification code required 
for transmission and reception of information with an 
input from the telephone terminal 5 and facsimile appa- 
ratus 6 to make access to the information network of 
this type from these apparatuses. The Gaia code is gen- 
erated, as required, in place of the identification code by 
an ordinary ASCII code depending on selection by 
users or depenring on the terminal or server as a part- 
ner of communication with the server 1 . Accordingly, the 
server 1 is also capable of transmitting and receiving 
various pieces of information to and from ordinary serv- 
ers in the internet. 

Moreover, the server 1 holds a retrieval table 13A in 
the external memory apparatus 1 3 so that it can assure, 
regarding the Gaia code, the one-to-one correspond- 
ence between each identification code and information 
on the network and terminal. This retrieval table 13A 
may be retrieved as required by the central processing 
means 9. 

Here, a telephone terminal is used in the embodi- 
ment, but the Gaia code may be formed through combi- 
nation of the codes (including characters and signs, 
etc.) corresponding to the operators of the other com- 
munication terminals, for example, computer and pri- 
vate terminal, etc. 

This retrieval table 13A is placed under the man- 
agement, like a DNS (Domain Name System), for exam- 
ple, incorporation with the same type of server 
connected to the internet (hereinafter, the server func- 
tion by the Gaia code is called the Gaia server). 
Thereby, a large number of code information can be 
effectively processed and administrated. Accordingly, 
each Gaia server is enough to be linked with the adja- 
cent other Gaia server. 

Thereby, as shown in Fig. 2, in this embodiment, 
the server 1 can transmit or receive, on the contrary, an 
electronic mail to the electronic mail address 
"ogawa@pdp.crLson.co.jp'' on the corresponding inter- 
net with reference to the retrieval table 13A from the 
electronic mail address of n 0123*125#48", for example, 
through the network NET on he internet formed of the 
Gaia servers 1 A to 1 F of the same type. 

Thereby, the server 1 is capable of receiving an 
electronic mail via the telephone terminal 5 when the 
electronic mail information is given as the voice signal 
and ,in the same manner, receiving the various kinds of 
information offered of voice data by identifying the infor- 
mation originator with the telephone terminal. Moreover, 
in the same manner, when the information to be trans- 
mitted and received is the image data of the facsimile 
apparatus 6, information service can be received 
through the facsimile apparatus 6. On the contrary a 
computer 4 is capable of transmitting various pieces of 
information by designating the terminals such as tele- 
phone terminal 5. facsimile apparatus 6 and pager, eta 

Basically, the identification code is formed , as 
shown in Fig. 3. of the Gaia code to identify each com- 
puter, etc. Namely, the Gaia code can be discriminated 
depending on the identifier arranged at the leading 
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edge. When the identifier has a value "0", the Gaia code 
is the attribute code which is generated by encoding the 
character string of the ASCII (American Standard Code 
for Information Interchange) code. Therefore, when the 

5 identifier is given by the value "1 ". it indicate the corre- 
sponding index code of the information in the memory 
apparatus on the network. This index code indicates the 
code for identifying the position of the Gaia server and 
the index in this server. Briefly, the index cede is a so- 

w called abbreviation number and can be obtained by 
encoding the address of information used frequently 
and the a communication terminal number. 

The attribute code is generated, as shown Fig. 4, by 
the encoding in the data format converting means 8 or 

is by the direct input from the telephone terminal 5 and the 
identifier of two digits indicating the contents are 
assigned, following the identifier "0" indicating the 
attribute code. The attribute code identifying the access 
destination with this identifier indicates, when the identi- 

20 f ier of two digits has the value "0 1", that the subsequent 
content is telephone number. In this case, the subse- 
quent content is formed by describing the telephone 
number. Moreover, when the identifier of two digits has 
the values "02" and "03". it indicate that the subsequent 

25 content is the facsimile number of G3 type and G4 type. 
In this case, the subsequent content is formed by 
describing the number in direct. 

Meanwhile, when the identifier of two digits has the 
values "04" and "05", it indicates that the subsequent 

30 content is the address by HTTP (Hyper Text Transfer 
Protocol) and the electronic mail address. In the former 
case, the address after "http:" is encoded, while in the 
latter case, the address as a whole is encoded by the 
data format converting means 8 or an input is applied in 

35 direct from the telephone terminal 5, etc. 

Here, the encoding is performed, as shown in Fig. 
5. by converting each character code into the decimal 
number of three digits for each character string (Fig. 5A 
and Fig. 5B) expressed by the hexadecimal number wit 

40 the ASCII code and then coupling such decimal num- 
bers. Thereby, as shown in Fig. 6, various address data 
such as telephone number, facsimile number of G3 for- 
mat and electronic mail address, etc. are expressed by 
the Gaia code corresponding on one to one basis. In 

46 addition, on the occasion of this encoding, it is possible 
to provide convenience to user for input of the Gaia 
code from the telephone set, etc. by conducting com- 
pression of data, such as the Huffman coding. 

Therefore, the data format converting means 8 con- 
so verts, as required, between the ASCII code and Gaia 
codes in the data communication with ordinary servers 
on the internet and communication with user terminals 
such as computer 4, eta, the addresses on the elec- 
tronic mail addresses and world wide webs. Moreover, 

55 the converters inputs, for the access from the telephone 
terminal 5 and facsimile apparatus 6, in direct, the 
addresses of the Gaia code from these apparatuses to 
the Gaia servers. 

Moreover, the data format converting means 8 exe- 
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cutes data compression by applying the predetermined 
data compression method depending on the generation 
probability of the same numerals in the Gaia codes gen- 
erated as explained above. Thereby, the data format 
converting means 8 is capable of efficiently transmitting 
the Gaia code data by compressing the increasing data 
length through the encoding process of this type. 

Meanwhile, the index code is formatted by the hier- 
archical structure and in this embodiment, such index 
code is generated by utilizing the country code and area 
code of the telephone number. Namely, as shown in Fig. 
7, the index code is formed in such a manner that the 
value "1 " is followed by the country code, area code and 
is then by the index in the server. 

Thereby, in the Gaia server, the index code is proc- 
essed to offer the services which users desire by apply- 
ing the management method for domain information by 
DNS in the electronic mails of itnernet and for corre- 
spondence between the host name and IP address. 

Namely, as shown in Fig. 8, when a request of the 
index code "1140812345" including the identifier is 
issued, for example, to the Gaia server 1A having the 
area code "03" in Japan having the country code "81", 
the central processing means 9 of this Gaia server 1 A 
judges the index code from the identifier of the leading 
digits and inquires the index code "140812345" to the 
Gaia server 1B of the upper rank to administrate Japan 
because the subsequent country code is different 

The Gaia server IB having received this inquiry 
also inquires the index code "140812345" to the Gaia 
server 1 D of further higher rank to administrate ail serv- 
ers in the world because the country code is different. 
The Gaia server 1D which administrates the world 
retrieves its own retrieval table and inquires here the 
index code "40812345" to the Gaia server 1E which 
administrates the U.S. A with reference to the country 
code. 

Upon reception of this inquiry, the Gaia server 1 E 
also retrieves the retrieval table and then inquires the 
index code "12345" to the Gaia server 1F which admin- 
istrates California with reference to the subsequent area 
code. Thereby, the Gaia server 1F having received this 
inquiry transmits the necessary information to the Gaia 
server 1E and this Gaia server 1E transmits this infor- 
mation to the Gaia server 10 which administrates the 
world in accordance with the inquiry information which 
has been once stored. Moreover, this information is 
then sequentially transferred, in accordance with the 
corresponding inquiry information, to the Gaia server 
1B which administrates Japan and the Gaia server 1 A 
which administrates the area having the area code "03" 
and is finally transferred to the user terminals. 

Thereby, the Gaia server 1 retrieves the corre- 
sponding information with reference to the index code 
by the Gaia code and offers the retrieved information to 
the computer 4, telephone terminal 5 and facsimile 
apparatus 6. etc. 

In the case of electronic mail service, the server 1 
judges the destination of an electronic mail with the 
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attribute information. When the destination is given as 
the address, contents and address of the mail are 
printed by an external printer 17 and the electronic mail 
is mailed to this address. 

5 Fig. 9 is a table indicating address data correspond- 
ing to the attribute codes of the identification code. 
Here, these address data are given the attribute infor- 
mation indicating a kind of data for identifying electronic 
mail address, address by http and ftp, address and tele- 

10 phone number, etc. Therefore, the Gaia server 1 holds 
these address data in the external memory apparatus 
13 and offers these address data as required. 

(3) MAM server (Multi Address Mapping Server) 

15 

In order to assure sufficient security in offering of 
such address data, the Gaia server 1 sets, as shown in 
Fig. 10, the access right data to the leading edge of 
each address data depending on designation from 

20 users and operation of the network. In addition, the Gaia 
server 1 allows, when the data for access right is set 
open, free access to this data as the open data. If the 
access right data is set closed, disclose of data is 
stopped, as required, by confirming the access. 

25 In regard to the information designated in local, this 
information is held once in the MAM server 1 and there- 
after this local information is offered by the MAM server 
1 , as shown in Fig. 1 1 , corresponding to aocess check 
request and request for referring to local information 

30 from the Gaia server. Therefore, the MAM server 1 is 
structured of a server program by the same processing 
means 9, etc. as the Gaia server 1 in order to realize the 
services such as multi-address communications by the 
Gaia server 1 and security may be assured and the 

35 services such as multi-address communication and 
aliasing, etc. which will be explained later may also be 
offered by switching the information response to each 
inquiry from such Gaia server 1 . Here, the local informa- 
tion means the information for making reference to the 

40 MAM server where the actual addresses exist. 

For the aocess check request, the MAM server 1 
requests input of the password number to a user and 
judges success or failure of access by identifying a user 
from the password number. When services are offered 

45 by voices, this MAM server 1 requests input of voice as 
required as will be explained later and executes the 
processing for user identification through voice recogni- 
tion, etc. 

Since the Gaia server and MAM server have been 
so structured as explained above, the server 1 of Fig. 1 
structures, as shewn in Fig. 12, the MAM server 21, 
Gaia code server 22 and management server 23 and is 
then connected to an electronic mail spool 25, etc. of 
the local domain 24 via the internet 2. Fig. 12 illustrates 
55 the central processing means 9 of Fig. 1 through the 
classified three functions of the MAM sever, Gaia code 
server and management server. 

the MAM server 1 refers to the user information 
management database 13B held in the external mem- 
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ory appartus 13 for the reference from the Gaia code 
server and executes various kinds of services by return- 
ing, for example, the local information. 

(3-1 ) User information management database s 

Here, as shown in Fig. 13, the user information 
management database 13B is formed of a Gaia code 
incorporation table and a user information database. As 
shown in Fig. 14, the Gaia code incorporation table reg- 10 
isters the incorporated users of all Gaia codes adminis- 
trated by the server 1 together with object classification 
identified by the Gaia code. The link with the user infor- 
mation database is set depending on this classification. 
In the user information management database, only the ?5 
users registered in each Gaia code are recognized to 
update the classification incorporated to each Gaia 
code and user information management database. 

For instance, in Fig. 14, it is indicated that the codes 
starting from the Gaia code "0 1 000" are incorporated to 20 
a person A and the codes starting from the Gaia code 
"02000" are incorporated to a group B. Of the Gaia 
codes incorporated to a person A, the Gaia code 
"01012" identifies a virtual telephone terminal of the 
person A, while the code "01013" identifies a virtual 25 
computer terminal or private terminal of the person A. 
Here, a virtual communication terminal has been set 
considering convenience of transfer to the communica- 
tion terminals liked which will be explained later. 

Moreover, the Gaia code "01021" identifies a hole 30 
telephone terminal of the person A, while the Gaia 
codes "01022" and "01023" identify the telephone termi- 
nals (hand-held telephone sets) in the office and the 
other attending place of the person A. 

Meanwhile, as shown in Fig. 15, the user informa- 35 
tion database summarizes user information fa each 
user registered in the Gaia code incorporation table. 
Each user information is famed of user data, non-termi- 
nal data and terminal data. The user data is structured 
of registered person data, schedule data and transfer 40 
operation data. Moreover, the non-terminal data and 
terminal data are structured of the data fa identifying 
information transfer destination such as telephone 
number and mail address, etc. of the tempaary and 
permanent places. 45 

As shown in Fig. 16, the registered person data of 
user data is the data of registered person himself and is 
composed of the Gaia code, password number and per- 
sonal name, etc. The password number is used to iden- 
tify the registered user and is formed to allow the access so 
of only the registered users. Moreover, a personal name 
is set allowing registration of a plurality of names and 
thereby a pen name, for example, may also be regis- 
tered in addition to own name and the reference access 
right for disclosing or not the access from users can also ss 
be set. The names in Fig. 16 are set to disclose the con- 
tents of all accesses. In addition to these names, as the 
registered person data, the voice templete for user iden- 
tification and a keyword used fa user identification may 
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also be registered. 

On the other hand, the schedule data indicates user 
schedule and is structured of the real data indicating 
contents of schedule and data indicating the reference 
aocess right. In this Fig. 16, it is registered that a person 
A went to an amusement park on May 7, 1 996 and took 
the long term holiday from April 26 to May 7, 1996. 
Moreover, the access right is set, in regard to the sched- 
ule of May 7, 1 996, so that reference is allowed only to 
a person C (Fig. 14) who is identified by the Gaia code 
"03000". In the same manner, in regard to the schedule 
of days from April 26 to May 7, 1 996, the access right is 
set so that reference is allowed to a person C identified 
by the Gaia code "03000" and a group B identified by 
the Gaia code "02000". 

In this user data, as the setting of such reference 
access right, time and location of registered users may 
also be registered in addition to the Gaia codes. 
Thereby, various conditions may be set, for example, 
midnight access is inhibited. It is also possible, moreo- 
ver, to set to present the particular data for the access 
from a particular person. Accordingly, a message can 
be transmitted by voice signal or voice data and moreo- 
ver a map till the home may also be presented by image 
data. 

The transfer operation data is formed with registra- 
tion of contents of processing which is executed in dif- 
ferent manner from the usual processing by user when 
information of electronic mail, etc. is transmitted to the 
Gaia code to which the users are incorporated. In Fig. 
1 6, when it is requested to transfer the electronic mail to 
a person A to the facsimile apparatus (Fig. 14) of the 
Gaia code "01 041 ", it is specified that the electronic mail 
is transmitted after it is converted to the image data cor- 
responding to the facsimile apparatus and when it is 
requested to transfer the electronic mail to the tele- 
phone terminal of the Gaia code "01023", it is specified 
that the ringing signal is once transmitted. 

In these cases, the access right is set to be able to 
make reference to this setting for the group B identified 
by the Gaia code "02000" and the person C identified by 
the Gaia code "03000". As the transfer operations, vari- 
ous conditions may be set by setting of the non-terminal 
data. For example, transmission of information from the 
particular Gaia code may be set for various conditions in 
the case of transmission to the particular transfer desti- 
nation, namely, information is transferred to the particu- 
lar transfer destination within the predetermined time. In 
these cases or in other cases, the server 1 sets these 
operating conditions to register the processes such as 
display of the name of originator and title of the elec- 
tronic mail to the pager, for example, when an electronic 
mail is received and a when it is recorded in the elec- 
tronic mail spool. 

As shown in Fig. 17, the non-terminal data relates 
to the non-terminal (virtual) Gaia code to which this user 
is incorporated and this data is formed of the telephone 
number and non-terminal mail address. In this case, the 
telephone number identified by the Gaia code "01012" 
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is registered as the object telephone number and four 
linking destinations are registered for this telephone 
number according to the conditions. Namely, as a 
default (without condition), the link destination and con- 
ditions are registered so that the information to this tele- 
phone number is transferred to the telephone number 
identified by "01021" and transferred, as an exception, 
to the telephone number identified by the Gaia code 
"01022" during the time from 9:00 to 18:00 of the week 
days. 

Moreover, corresponding to the schedule of a user, 
the link destination and conditions are registered so that 
information is transferred to the telephone number iden- 
tified by the Gaia code "01023" on May 7, 1996 and the 
link destination is invalidated every day during the time 
from 22:00 to 7:00 and telephone call fa the Gaia code 
"01012" is not connected. In this case, the server 1 
sends the operation data to an originator with the guide 
by voice or is capable of registering these operations to 
the transfer operation of the user data so that a mes- 
sage recorded previously in the recording and repro- 
ducing means 12 can be transmitted to an originator. 

Moreover, in this case, whether these link destina- 
tion and condition are opened or not to any user is spec- 
ified by the reference access right. When the link 
destination and condition are overlapped, the server 1 is 
caused to transfer the information to the link destination 
under the higher priority condition set by the user. In any 
case, default has the lowest priority. In this embodiment, 
the condition for specifying the link destination may also 
be set depending on the Gaia code of originator and the 
current position of the user registered. Thereby, this 
server can freely transfer the telephone call as required. 

The mail address is the data regarding the non-ter- 
minal mail address to which this user is incorporated 
and is structured, as in the case of the telephone 
number, of the Gaia code indicating the mail address of 
an object, link destination and reference access right. 
Here, the electronic mail of the address "01013" is reg- 
istered as an object and the link destination is registered 
depending on three conditions for this mail address. 
Namely, information to this mail address as the default 
is transferred to the transfer destination identified by the 
Gaia codes "01031" and "01032" and it is also regis- 
tered that all users are capable of making reference to 
this relationship. Moreover, information from the Gaia 
code "02000" is transferred to the transfer destination 
identified by the Gaia code "01032" and it is also regis- 
tered that only the user of the Gaia code "02000" is 
capable of making reference to this relationship. 
Namely, the user having the reference access right can 
look over the conditions of the link destination. 

Moreover, corresponding to the schedule of a user, 
it is registered that information is transferred, on May 7, 
1996, to the transfer destination identified by the Gaia 
codes "01031" and "01032" and only the user of the 
Gaia code "03000" is capable of making reference to 
this relationship. With the relationship of these links, the 
server 1 transfers the electronic mail, converts the mes- 



sage into the image data of the facsimile < pparatus 
depending on registration of the transfer opjration of 
user data and issues once the ringing signal. 

A terminal data is the data regarding the Gaia code 

s of the terminal to which this user is incorporated as 
shown in Fig. 18. This terminal data is constituted of tel- 
ephone number, mail address of terminal, facsimile 
apparatus number and pager number. Here, it is regis- 
tered that the telephone number identified by the Gaia 

10 code "01021" is the home telephone number, while the 
telephone numbers identified by the Gaia codes 
"01022" and "01 023" are the office telephone number 
and hand-held telephone number. Moreover, the refer- 
ence access rights are respectively set to these tele- 
is phone numbers. In the same manna', the related 
information and reference access right may also be reg- 
istered to the mail address, facsimile apparatus number 
and pager number. 

The user information management database 13B is 

20 set first to the default value when a user is registered to 
this serve- 1 and the setting is updated, at the time of 
registration and later, with the input of a user himself 
depending on the guide by voice. That is, Fig. 19 is a 
flowchart showing the setting update processing of the 

25 user information management database 13B. The cen- 
tral processing means 9 shifts to the step SP2 from the 
step SP1 in this processing sequence to execute the 
user identification. 

Here, the central processing means 9 urges a user 

30 to select the input means in accordance with the guide 
by voice signal and text data. Here, the central process- 
ing means 9 receives, by user's selection, input of ID 
and password number, etc. with voice input using the 
keyboard or voice recognition process and retrieves this 

35 ID and password number depending on the retrieval 
table 13A and user information management database 
13B to identify the user. In the case of access from the 
private terminal 15 and computer 4. the central process- 
ing means 9 automatically obtains the user ID and pass- 

40 word number with the communication with the auto-log- 
in program of the private terminal 15 and computer 4. 
Moreover, in this user identification process, the central 
processing means 9 makes inquiry as required to the 
other servers 1A to 1F to execute the table setting 

4S update process in this registered server 1 for the users 
registered in the other servers 1 . 

When a user is identified as the registered user by 
this user identification process as explained above, the 
central processing means 9 moves to the step SP3 and 

so notifies the menu which may be selected by the voice 
signal or text data. When a user selects here update of 
the user information management database with the 
key input or voice input, the central processing means 9 
notifies a registered table. Notification is executed by 

55 the method selected by a user. For example, for the user 
who has made access from the computer 4 or private 
terminal 15, a schedule, for example, requested by user 
is displayed via the display screen of the computer 4 or 
private terminal 15. 
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For the user who has made access from a tele- 
phone terminal 5, contents recorded by voice is notified 
only for the range which is desired by a user depending 
on the interactive format through voice recognition and 
speech synthesis. In addition, for a user who has made 5 
access from the facsimile apparatus 6, contents regis- 
tered by voice or image output from the facsimile appa- 
ratus 6 are notified, depending on selection by user, 
through a telephone terminal incorporated to the fac- 
simile apparatus 6. 10 

Subsequently, the central processing means 9 
shifts to the step SP4 to accept addition and update of 
contents notified from the user and thereafter shifts to 
the step SP 5 to complete this processing sequence. 
Thereby, in the server t, the user information manage- 15 
ment database is updated by user himself as required to 
update the telephone transfer destination. In this case, 
contents of addition and update are accepted by the 
voice recognition process in the services by voice or by 
the character recognition in the character recognizing 20 
means 14 for the access from the facsimile apparatus 6. 

On the other hand, when it is requested to know the 
schedule of a user, it is considered to make an inquiry to 
the user information management database from a third 
party because of the fact that the electronic mail is not 25 
transferred or by checking of the mail address of the 
direct mails. In this case, the central processing means 
9 executes the processing sequence shown in Fig. 20 
and permits only the inquiry to the authorized users by 
setting of the access right so 

Namely, the central processing means 9 shifts to 
the step SP12 from the step SP11 to execute- the user 
identification process as in the case of the setting 
update process of the user information management 
database explained above. Subsequently, the central 35 
processing means 9 shifts to the step SP13 to accept 
input of items desired for reference. Here, the central 
processing means 9 requests identification of user infor- 
mation desired for reference depending on the Gaia 
code (for example, 01000) of user who desires refer- 40 
ence, Gaia code of a terminal and ID, etc. and makes 
access to the corresponding user information manage- 
ment database 13B via this identification. Moreover, the 
central processing means 9 accepts input of reference 
items such as schedule, transfer destination and condi- 45 
tions, etc. and makes access to the corresponding 
items of the user information management database 
13B depencfing on this input. 

Subsequently, the central processing means 9 
shifts to the step SP14 to judge whether the user identi- so 
tied in the step SP12 is the one allowed to make access 
or not depending on the access right of the correspond- 
ing item. When the negative result is obtained, the cen- 
tral processing means 9 shifts to the step SP15 to 
transmits the message indicating that reference is not ss 
allowed to the user terminal which has made access 
using the voice signal, text data or image data corre- 
sponding to this user terminal and thereafter to shift to 
the step SP16 to complete the processing sequence. 



On the other hand, when the access right is set to 
permit the reference to this user, the central processing 
means 9 shifts to the step SP1 7 from the step SP14 to 
notify the preset items with the voice signal or text data 
and further to notify, when a user desires, such items 
with the image data of the facsimile apparatus in 
response to the selecting operation by user and thereaf- 
ter shifts to the step SP16. 

Thereby, in the server 1, the users to whom the 
access right is set and the identified person are allowed 
to make reference to contents of the user information 
management database. 

(4) Electronic mail (E-mail) 

In this embodiment, the central processing means 9 
executes, after it is started by calling from the telephone 
network, the user identification process to the terminals. 
Here, when a user is identified, the central processing 
means 9 presents the selection menu and accepts an 
electronic mail originated from a user when the user 
selects origination of the electronic mail. 

In this series of processes, when the computer 4 
originates this electronic mail, the central processing 
means 9 receives destination address and contents of 
electronic mail by mainly transmitting and receiving the 
text data to and from the computer 4. 

Namely, the central processing means 9 urges first 
a user to select the destination input method through 
communication with the communication program in the 
computer 4. When the user selects input by the Gaia 
code, the means 9 subsequently urges the user to input 
the destination by the Gaia code. When the user has 
selected the ordinary input of the electronic mail 
address of the internet, etc., the central processing 
means 9 urges the input of destination by the corre- 
sponding method in the same manner. 

Upon acceptance of the input of destination, the 
central processing means 9 subsequently urges the 
user to select the subject line input method. Here, when 
the user selects input by text data, the means 9 subse- 
quently urges input of the subject line consisting of the 
headline of the electronic mail to accept this input 
Moreover, the central processing means 9 accepts con- 
tents of the electronic mail in the same manner and 
stores this contents in the external memory apparatus 
13. 

Thereafter, the central processing means 9 makes 
communication with the server which is administrating 
the Gaia codes of the destination as in the case 
described in regard to Fig. 8 to obtain the electronic mail 
address corresponding to this Gaia code and forms a 
draft of the electronic mail in the external memory appa- 
ratus 13 depending on this electronic mail address. 
Subsequently, the central processing means 9 origi- 
nates this electronic mail to the internet 2. When the 
destination user is the one administrated by this server 
1, the central processing means 9 holds in direct the 
draft of electronic mail in the external memory appara- 
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tus13. 

Finally, the central processing means 9 notifies 
completion of transmission to the user who has input 
this electronic mail and thereafter closes the line to the 
user by means of the user's operation. In the transmis- 5 
sion of electronic mail from the computer 4 explained 
above, when a user selects the transmission of elec- 
tronic mail by the facsimile apparatus and transmission 
of mail by voice, the central processing means 9 
accepts the electronic mail with the same process as 10 
the transmission of electronic mail from the facsimile 
apparatus 6 and telephone terminal 5 explained later. 

In this embodiment, the central processing means 9 
makes access to the user information management 
database 13B in common to the input of the subject by 75 
various input methods to adds, to this subject, various 
data as much as possible, for example, header indicat- 
ing type of terminal used by access for making access, 
time information indicating day and time of access, sex 
and age of a user and language used for the electronic 20 
mail, etc. 

When a user does not transmit an electronic mail 
from the previously registered terminal, the information 
of this kind is obtained and added through the line and 
contact for starting the communication as in the case of 25 
storing the information of this type into the user informa- 
tion management database 13B. Moreover, when the 
information is not yet registered in the user information 
management database 13B, the data indicating type of 
apparatus is added by the method as explained above 30 
and sex, age and language used are added by user 
input. When voice input method is used, such data are 
judged and added on the basis of the voice recognition 
method. 

Thereby, the server 1 assures convenience for 35 
retrieval on the occasion of transmitting the electronic 
mail. 

(4-1) Transmission of electronic mail from telephone ter- 
minal 40 

Rg. 21 is a flowchart showing the operation 
sequence of user and server 1 for accepting an elec- 
tronic mail from a telephone terminal 5. Fig. 22 is a flow- 
chart showing communication between the telephone 46 
terminal 5 and server 1. Rg. 23 is a flowchart showing 
continuous operations of Rg. 22. In Fig. 22 and Rg. 23, 
the processing steps in common to Fig. 21 are indicated 
by the same code In this case, the central processing 
means 9 shifts to the step SP31 from the step SP30 to so 
wait for the calling. Under this condition, the user shifts 
to the step SP33 from the step SP32 to dial by operating 
the operator of the telephone terminal 5. Thereby, the 
central processing means 9 is activated by the calling 
from the telephone terminal. ss 

Subsequently, the central processing means 9 exe- 
cutes the user identification process to this terminal and 
presents the selection menu, upon completion of user 
identification. Moreover, the central processing means 9 
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accepts an electronic mail issued from a user, when a 
user selects origination of electronic mail in response to 
this menu. For the access from this telephone terminal, 
the central processing means 9 activates the speech 
synthesis means 11 or recording and reproducing 
means 12 and presents the selection menu with the 
guide by voice. Moreover, in this case, the central 
processing means 9 detects the operator of the tele- 
phone terminal 5 operated by user in response to the 
guide by voice with the DTMF signal detected through 
the telephone network connecting means 3 and thereby 
accepts the selected input by user. 

In this series of operations, the central processing 
means 9 accepts, in the step SP35, the destination 
input by user in the step SP34. The destination input 
and destination acceptance processes are executed by 
the processing sequence of Fig. 24. Namely, the user 
shifts to the step SP37 from the step SP36 to wait for 
the input method request, while the central processing 
means 9 shifts to the step SP39 from the step SP38 to 
request selection of input method. 

In the case of input from the telephone terminal 5, 
the server 1 is capable of selecting input by the opera- 
tion of operator of the telephone terminal or input utiliz- 
ing the voice recognition and moreover, in this case, the 
destination input by the Gaia code or input of electronic 
mail address such as an ordinary internet may be 
selected. The central processing means 9 activates the 
speech synthesis means 1 1 or recording and reproduc- 
ing means 1 2 to urge selection of input method with the 
guide by voice and thereafter the means 9 shifts to the 
step SP40 to waits for selection of the input method. 
Here, a user shifts to the step SP41 from the step SP37 
to select the input method by operating, for example, an 
operator of the telephone terminal 5 and thereafter 
shifts to the step SP42 to wait for destination input 
request. 

In response to the user, the central processing 
means 9 shifts to the step SP43 from the step SP40 to 
request, with the guide by voice, input of destination 
depending on the input method selected by user and 
thereafter shifts to the step SP44 to wait for input of des- 
tination. When the user selects input of destination of 
the Gaia code, the central processing means 9 trans- 
mits a voice message urging input of the Gaia code at 
the time of requesting input of destination and waits for 
input of destination. 

Thereby, a user shifts to the stop SP45 from the 
step SP42 to input the destination with the Gaia code by 
operating the operators of numerals "0" to "9" or opera- 
tors of or "# M . Thereafter, a user shifts to the step 
SP46 to complete the process for inputting the destina- 
tion. In response to this process, the central processing 
means 9 accepts the destination and then shifts to the 
stop SP47 to complete the destination acceptance proc- 
ess. 

When input and acceptance of destination is com- 
pleted as explained above, a user shifts to the step 
SP49 (Fig. 21) to input the subject line, while the central 
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processing means 9 accepts input of the subject tine in 
the step SP50. The process for inputting the subject line 
and accepting the subject line is executed by the 
processing sequence shown in Fig. 25. 

Namely, a user shifts to the step SP62 from the step s 
SP51 to wait for request of the input method, while the 
central processing means 9 shifts to the step SP54 from 
the step SP53 to request selection of the input method 
and thereafter shifts to the step SP55 to wait for the 
response. In this case, the central processing means 9 10 
also urges, with the guide by voice, a user to select the 
input method. In this embodiment, input by formatted 
sentence such as a telegram or input of free sentence 
by voice may be selected. 

Here, upon selection of the input method in the step is 
SP56 in response to the input method selection request, 
a user shifts to the step SP57 to wait for the request for 
input of subject, while the central processing means 9 
shifts to the step SP58 from the step SPSS to request 
input of the subject in accordance with the input method 20 
selected by user and thereafter shifts to the step SP59 
to wait for response. When a user selects input of sub- 
ject by voice, he responses to the request for input of 
subject and inputs a voice message in the step SP60 
and finally notifies completion of input by operating, for 25 
example, the operator and thereafter shifts to the 
step SP61 to complete the processing sequence. 
Meanwhile, the central processing means 9 activates 
the recording and reproducing means 12 to record a 
voice signal input from a user and shifts to the step 30 
SP62 to complete the processing sequence. 

When input and acceptance of subject are com- 
pleted, a user shifts to the step SP64 (Fig. 21) to input 
contents of an electronic mail, while the central process- 
ing means 9 accepts input of contents in the step SP65. 35 
Input and accepting process of contents are executed 
by the processing sequence shown in Fig. 26. Namely, 
a user shifts to the step SP67 from the step SP66 to wait 
for the request for input of contents, while the central 
processing means 9 shifts to the step SP69 from the 40 
step SP68 to request input of contents with the guide by 
voice and thereafter shifts to the step SP70 to wait for 
response. Here, a user inputs, response to the input 
request for contents, a voice message in the step SP71 
and notifies completion of input by operating the opera- 45 
tor T, for example, as in the case of input of subject 
and then shifts to the step SP72 to wait for the 
response. 

Meanwhile, the central processing means 9 drives 
the recording and reproducing means 12 to record the so 
voice signal input from a user and thereafter shifts to the 
step SP73 to sending a message notifying that contents 
have been received. In response to this process, a user 
shifts to the step SP 74 from the step SP72 to complete 
this processing sequence, while the central processing ss 
means 9 also shifts to the step SP75 from the step 
SP73 to also complete this processing sequence. 

Upon completion of input and acceptance of con- 
tents, the central processing means 9 shifts to the step 
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SP76 (Fig. 21) to convert the input items into the prede- 
termined format to generate an electronic mail and then 
send this electronic mail. In this processing, the central 
processing means 9 obtains, as explained in regard to 
Fig. 8. the electronic mail address corresponding to the 
Gaia code through the communication with the server 
which is administrating the Gaia code of destination and 
forms a draft of the electronic mail in the external mem- 
ory apparatus 13 based on this electronic mail address. 
In regard to the voice recorded in the recording and 
reproducing means 12, the central processing means 9 
executes the analog-digital conversion to this voice sig- 
nal to obtain the file of ISDN u-law format and thereafter 
converts this file into the MIME (Multipurpose Internet 
Mail Extension) format to assign the voice signals to 
subject and contents of the electronic mail based on 
such format. Upon processing of the voice signal as 
explained above, the central processing means 9 origi- 
nates this electronic mail to the Internet 2. When the 
destination user is administrated by the server 1, the 
central processing means 9 holds in direct the docu- 
ment of electronic mail in the external memory appara- 
tus 13. 

Thereby, a user shuts off the line in the step SP78 
corresponding to the message indicating reception of 
contents and thereafter shifts to the step SP79 to com- 
plete this processing sequence. In the same manner, 
the central processing means 9 also shifts to the step 
SP80 from the step 76 to shut off the line and thereafter 
shifts to the step SP81 to complete this processing 
sequence. 

Thereby, the server 1 inputs the destination of the 
Gaia code in the telephone terminal 5 with the operation 
of operator depending on the guide by voice and there- 
after inputs the subject sentence and main sentence of 
the electronic mail by voice to originate the electronic 
mail. 

Fig, 27 is a flowchart showing the processing 
sequence of destination input with the keyword input by 
voice. Fig. 28 and Fig. 29 are flowcharts showing com- 
munication between the telephone terminal 5 and 
server 1 when the destination input is selected. In Fig. 
27 to Fig. 29, the processing sequence corresponding 
to that of Fig. 21 to Fig. 26 is given the similar codes. 

This processing sequence corresponds to the case 
where a user has operated the operator indicating the 
voice keyword input depending on the guide by voice for 
the input method request in the step SP39 for the selec- 
tion of the destination input method in the step SP41 
after the user and central processing means 9 have 
started this destination input processing sequence in 
the steps SP85 and SP86. In this case, the central 
processing means 9 urges a user to input the keyword 
indicating the destination at the time of requesting the 
destination in the step SP87 corresponding to the selec- 
tion by user and then shifts to the step SP88 to wait for 
the response. 

The keyword used here is a term preset in the sys- 
tem and the destination of electronic mail can uniquely 
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be determined using this keyword. In this embodiment, 
an address, user name, handle name, etc. which are 
similar to those used in the telephone number guide, for 
example, in the public telephone network may be used 
as the keyword. A user can select individual keyword by 5 
previously registering it. In response to destination 
request a user voices the keyword indicating the desti- 
nation in the step SP89 and thereafter notifies the end 
of input by operating the operator M #" and shifts to the 
stop SP90 to wait for repeating of the keyword in the 70 
server 1 . 

In response to this process, the central processing 
means 9 activates operation of the voice recognition 
means 10 and executes voice recognition for the voice 
signal input sequentially and detects operation of the 15 
operator in the step SP91. Thereafter, the central 
processing means 9 shifts to the step SP92 to activate 
the speech synthesis means 1 1 to execute the speech 
synthesis for the recognized contents and output this 
contents. Moreover, the central processing means 9 20 
also activates, in the subsequent step SP93. operations 
of the speech synthesis means 1 1 or recording and 
reproducing means 12 to urge these means to check 
whether speech recognition has been executed nor- 
mally or not with the guide by voice. 25 

In response to this process, a user shifts to the step 
SP95, upon judgment that correct voice recognition has 
been performed, to operate the operator indicating 
acknowledgment depending on the guide by voice and 
thereafter shifts to the step SP96 to complete the desti- 30 
nation input process. Meanwhile, the central processing 
means 9 detects, in the step SP97, the check operation 
by user and shifts, when a user has input the destination 
accurately, to the step SP98 to complete this processing 
sequence. 35 

On the other hand, when it is judged that a user 
cannot input destination accurately, a user shifts to the 
step SP 99 from the step SP94 to operates the operator 
indicating that the repeated destination is not acknowl- 
edged and then returns to the step SP42 to input again 40 
the destination. Corresponding to this process, the cen- 
tral processing means 9 returns again to the step SP87, 
upon detection of the operation by this user indicating 
that destination is not acknowledged in the step SP97, 
to output again the destination request. 45 

Thereby, the server 1 is allowed to also input the 
destination by voice and can easily input the destination 
using the keyword. Accordingly, the central processing 
means 9 is capable of making access to the user infor- 
mation management database 13B using the keyword so 
input and issuing an inquiry as required to the server 1 
to generate an electronic mail address. 

However, it is also considered that correct voice 
recognition is impossible even if voice input is repeated 
as explained above. This embodiment is therefore ss 
structured so that the input method may be changed in 
the course of the input operation depending on the 
selection by a user. Fig. 30 and Fig. 31 are flowcharts 
showing the processing sequence when the input 
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method is changed. Fig. 32 is the flowchart showing the 
communication sequence in this process. In Fig. 30 to 
Fig. 32. the processes similar to that of the above 
sequence are designated by the same codes. 

Namely, in this case, a user and the central 
processing means 9 respectively start the destination 
input process in the step SP100 and the step SP101 
and the central processing means 9 issues the destina- 
tion input method selection request in the step SP39. In 
response to this operation, a user notifies the input 
method in the step SP41. When input by the Gaia code 
is selected here, a user shifts to the step SP42b from 
the step SP102 to input the destination with the Gaia 
code as in the case described in regard to Fig. 42 and 
thereafter shifts to the step SP103 to complete this 
processing sequence. In response to this operation, the 
central processing means 9 shifts to the step SP104 
from the step SP88 to accept this input and then shifts 
to the step SP106 to complete this processing 
sequence. 

Meanwhile, when a user selects the destination 
input by the voice keyword, a user shifts to the step 
SP42a from the step SP1 02 to input the destination with 
the processing sequence similar to that described in 
regard to Fig. 27. In the same manner, the central 
processing means 9 shifts to the step SP91 from the 
step SP104 to accept destination input by user with the 
voice recognition. 

If it is judged that the voice recognition is not cor- 
rectly executed at the time of inputting the destination, a 
user shifts to the step SP99 from the step SP94 to oper- 
ate the corresponding operator to notify the server 1 
and thereafter returns to the step SP42a. In response to 
this operation, the central processing means 9 returns 
to the step SP87 from the step SP97. 

In the course of this process, the central processing 
means 9 notifies a user, in the step SP105, whether the 
destination input method with guide by voice is selected 
or not under the condition that a user is waiting for the 
destination request. A user receives this notice in the 
step SP106. When a user desires the repetitive selec- 
tion, a user shifts to the step SP107 to operate an oper- 
ator to instruct the repetitive selection. Thereby, the 
central processing means 9 obtains acknowledgment 
result in the step SP105 and returns to the step SP39. 

Here, the central processing means 9 newly issues 
the input method request In response to this operation, 
a user returns to the step SP41 from the step SP107 to 
newly select the input method. If a user does not admit 
necessity of repetitive selection of input method, a user 
shifts to the step SP89 from the step SP106, while the 
central processing means 9 shifts, in response to a 
user, to the step SP87 from the step SP105 to repeat 
again the voice recognition process. 

Thereby, the server 1 inputs, if voice recognition is 
difficult, the destination by the key input of the Gaia 
code to surely originate an electronic mail from the tele- 
phone terminal 5. 

Fig. 33 is a flowchart showing the processing 
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sequence in which a user selects contents of an elec- 
tronic mail from the formatted sentence and the free 
sentence. Fig. 34 is a flowchart showing the continuous 
processing sequence of Fig. 33. Fig. 35 and Fig. 36 are 
flowcharts shewing the communication sequence when 5 
a user has selected the formatted sentence and free 
sentence. Namely, the server 1 can select contents of 
an electronic mail, in addition to the subject, in the form 
of the formatted sentence and free sentence. In Fig. 33 
to Fig. 35, the same processes as that in Fig. 23 and 10 
Fig. 26 are given the corresponding codes. 

Namely, a user shifts to the step SP111 from the 
step SP110 to wait for the input method selection 
request. While the central processing means 9 shifts to 
the step SP1 13 from the step SP1 12 to output the input is 
method selection request. In this case, the central 
processing means 9 activates the speech synthesis 
means 11 or recording and reproducing means 12 to 
urge operation of operator with the guide by voice and 
thereafter shifts to the step SP1 14 to wait for selection 20 
of input method. In response to this process, a user 
selects the input method in the step SP115. When a 
user selects the input by formatted sentence, a user 
shifts to the step SP1 1 7 (Fig. 34) from the step SP1 16 
to wait for input request of the sentence example 25 
number. 

Meanwhile, the central processing means 9 shifts, 
in response to the user's operation, to the step SP1 19 
from the step SP1 18 to output the input request for the 
sentence example number and thereafter shifts to the 30 
step SP120 to wait for the response. Here, a sentence 
example is identified depending on a pamphlet distrib- 
uted previously to a user. In this embodiment, the for- 
matted sentence itself corresponding to the sentence 
example number can be confirmed through speech syn- 35 
thesis in response to user's operation. 

In this case, a user shifts to the step SP121 to input 
the sentence example number by operating the opera- 
tor of the telephone terminal 5 and thereafter shifts to 
the step SP1 22, after the check from the server side, to 40 
complete this processing sequence. In response to this 
operation, the central processing means 9 waits for 
input of the sentence example in the step SP120. Upon 
reception of the sentence example number, the central 
processing means 9 shifts to the step SP123, after the 45 
check by user, to complete this processing sequence. 
Thereby, the server 1 is capable of transmitting a condo- 
latory telegram, for example, by an electronic mail. 

Meanwhile, upon selection of a free sentence, a 
user shifts to the step SP67 from the step SP 1 1 6 to wait so 
for an input request Meanwhile, the central processing 
means 9 shifts to the step SP69 from the step SP 1 1 8 to 
issue an input request by voice input and shifts to the 
step SP70 to wait for the response. 

In response to this operation, a user shifts to the ss 
step SP71 from the step SP67 to generate contents of 
an electronic mail by generating voices and then shifts 
to the step SP1 25 to wait for repetition of voices. On the 
other hand, the central processing means 9 executes 
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the voice recognition process by the voice recognition 
means 10 in the step SP126 and executes speech syn- 
thesis for the voice recognition result in the subsequent 
step SP1 27 and then shifts to the step SP128 to wait for 
response. 

A user shifts, upon judgment that input is made in 
correct by the repetition of voices, to the step SP130 
from the step SP129 to generate a notice of acknowl- 
edgment with operation of operator and thereafter shifts 
to the step SP122 to complete this processing 
sequence. In response to this process, the central 
processing means 9 shifts to the step SP 123 from the 
step SP131, upon reception of the notice of acknowl- 
edgment, to complete this processing sequence. 

If contents are not recognized correctly by the voice 
recognition, a user shifts to the step SP123 from the 
step SP129 by operating the operator indicating nega- 
tive response to the repeated voices to notify incorrect 
voice recognition to the server 1 and then returns to the 
step SP67. In response to this operation, the central 
processing means 9 shifts to the step SP1 13 from the 
step SP131 to newly wait for selection of input method. 

Thereby, in this embodiment, an electronic mail 
may be originated by the formatted sentence or free 
sentence with the voice input from the telephone termi- 
nal 5. Moreover, an electronic mail may be originated by 
voices in the same manner with the telephone terminal 
incorporated to the facsimile apparatus 6 and the pri- 
vate terminal 15. 

(4-2) Transmission of electronic mail from a facsimile 
apparatus: 

Fig. 37 is a flowchart showing a part of the elec- 
tronic mail transmission sequence from a facsimile 
apparatus 6. In this embodiment, the destination and 
subject are input from a telephone terminal incorpo- 
rated to the facsimile apparatus 6 as in the case of the 
transmission of electronic mail from a telephone termi- 
nal 5 explained above. With execution of this processing 
sequence, an image data of the facsimile apparatus is 
assigned to contents of an electronic mail. 

Namely, a user shifts, upon completion of input of 
destination and subject, to the step SP1 41 from the step 
SP1 40 to wait for input request for contents via the tele- 
phone terminal incorporated to the facsimile apparatus 
6. Meanwhile, the central processing means 9 shifts, 
upon completion of input of destination and subject, to 
the step SP143 from the step SP142 to output the input 
request of contents with guide by voice and then shifts 
to the step SP144 to wart for response. 

In response to this operation, a user operates the 
transmission button of the facsimile apparatus in the 
step SP145 to transmit an image of document and 
thereafter shifts to the step SP146 to complete this 
processing sequence. Corresponding to this operation, 
the central processing means 9 inputs the image data of 
document from the waiting condition and thereafter 
shifts to the step SP147 to complete this processing 
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sequence. Thereby, the central processing means 9 
assigns this image data to the contents of an electronic 
mail and also checks the electronic mail address. 
Thereafter, the central processing means 9 originates 
the electronic mail to the Internet 2 or stores it in the 5 
external memory apparatus 13. 

Thereby, in this embodiment, a facsimile apparatus 
6 is also capable of transmitting an electronic mail. 

Moreover, in this embodiment, the central process- 
ing means 9 is also capable of inputting a destination of 10 
electronic mail with an image data by character recogni- 
tion of the image data inputted as explained above 
through user's selecting operation, thereby improving 
operation flexibility for a user. 

15 

(4-3) Services by MAM server 

An electronic mail transmitted to the corresponding 
server as explained above is held in the external mem- 
ory apparatus 13 of each server. In this case, the MAM 20 
server held by each server executes the processing 
sequence shown in Fig. 38 and thereby various kinds of 
services may be offered depending on the contents reg- 
istered in the user information management database 
13B. 25 

Namely, in the MAM server, the central processing 
means 9 shifts, upon distribution of an electronic mail, to 
the step SP151 from the step SP150 to make access to 
the user information management database of the cor- 
responding user depending on the address of electronic 30 
mail. Subsequently, the central processing means 9 
judges whether an effective link destination is specified 
or not for each corresponding user. When negative 
result is obtained, the central processing means 9 shifts 
to the step SP152. Here, the effective link destination 35 
means the link destination satisfying the conditions in 
the non-terminal data of the user information manage- 
ment database. 

When the effective link destination is specified, the 
central processing means 9 changes the destination of 40 
an electronic mail to this link destination. Thereby, for 
example, an electronic mail can be originated with the 
Gaia code for specifying a group. In this case, when a 
plurality of transfer destinations are specified to this 
Gaia code, so-called multi-address calling can be real- 4s 
ized to improve the processing flexibility of electronic 
mails of this kind. Moreover, when the Gaia code identi- 
fying the region is indicated by the link, the multi- 
address calling can be made to the users in the speci- 
fied region. Moreover, it is also possible to distribute an so 
electronic mail to a hand-held telephone set at the dis- 
tant area by transferring an electronic mail correspond- 
ing to the schedule and moreover, distribution of the 
electronic mail can be notified to a conference room 
only from a particular partner during the conference. In 55 
addition, the electronic mails distributed to the home tel- 
ephone, office telephone and hand-held telephone and 
moreover the electronic mails originated to the mail 
addresses of each network from various networks may 



also be read at a time. 

Subsequently, the central processing means 9 
shifts, upon obtaining the negative result by checking 
designation of the operating conditions in the step 
SP152, to the step SP154 to record the is electronic 
mail into the external memory apparatus 13 and there- 
after shifts to the step SP156 to complete the process- 
ing sequence. 

On the other hand, when the operating conditions 
are registered, the central processing means 9 shifts, 
upon reception of the positive result in the step SP152, 
to the step SP155 to execute the specified operation for 
the transfer operation. Namely, when it is registered as 
the operating condition that the contents of the main 
sentence formed by the text data is converted to the 
image data corresponding to the facsimile apparatus, 
the central processing means 9 executes this data con- 
version process and then shifts to the step SP154 to 
record the electronic mail depending on the converted 
image data into the external memory apparatus 13. 

Meanwhile, when it is registered that the ringing 
signal is once transmitted, the central processing 
means 9 executes this registered contents and thereaf- 
ter shifts to the step SP154. When it is registered that 
the image data of facsimile apparatus is converted to 
the text data, the central processing means 9 converts 
this image data into the text data after the character rec- 
ognition by the character recognition means 14 to store 
the electronic mail as the text data. Moreover, when it is 
registered that an address is registered as the transfer 
destination and it is output via the printer 17, the elec- 
tronic mail and address are output to the printer so that 
the electronic mail can be originated by mail. 

Even if the operating conditions are not specified 
different from above explanation, when the data format 
of the electronic mail is not applied to the terminal of the 
transmission destination, that is, when a facsimile appa- 
ratus is specified, for example, as the transmission des- 
tination or transfer destination in the user information 
management database 13B and content of the elec- 
tronic mail is image data such as JPEG, the central 
processing means 9 executes the data conversion proc- 
ess depending on the previous registration of the trans- 
mission destination user and thereby can improve 
application flexibility for user. 

(4-4) Output of electronic mail 

An electronic mail held by the server as explained 
above is then output by an access from an user. In this 
case, the server 1 outputs in direct, for the access from 
the computer 4, the text data and voice data, image data 
of ISDN u-law format, etc. held in the external memory 
apparatus as in the case of the ordinary network. In the 
same manner, the server 1 provides the similar output 
for the access from the private terminal 15. Thereby, the 
private terminal 15 is capable of displaying contents of 
the text data and image data on the liquid crystal display 
panel and checking contents of the voice data through a 



15 




EP0 810 



handset. 

In this case, the server 1 outputs the voice data with 
the voice signal, the text data with speech synthesis and 
the image data with the text data after character recog- 
nition depending on designation by user. In the same s 
manner, in the case of access from a facsimile appara- 
tus, the text data is output after it is converted to the 
image data corresponding to the facsimile apparatus. 
Thereby, the server 1 can improve the flexibility of oper- 
ation, w 

For the access from a telephone terminal 1, the 
server 1 executes the electronic mail retrieval service 
and reading service by voice For the access from a tel- 
ephone terminal incorporated to the facsimile apparatus 
6 and private terminal 15, such reading service is also is 
offered depending on selection by user. 

Fig. 39 is a flowchart showing the processing 
sequence of the user identification executed by the cen- 
tral processing means 9 when an electronic mail is out- 
put by access from a telephone terminal 5. In this user 20 
identification, the central processing means 9 shifts to 
the step SP161 from the step SP160 depending on the 
telephone call from a user to check the access from the 
user and thereafter shifts to the step SP162. 

In this step, the central processing means 9 acti- 25 
vates the speech synthesis means 11 or recording and 
reproducing means 12 to urge input of name with the 
guide by voice. In this step, a message "Your name, 
Please!" is output. Subsequently, the central processing 
means 9 shifts to the step SP163 to obtain the voice 30 
generated by a user and thereafter shifts to the step 
SP164 to execute voice recognition in the voice recogni- 
tion means 10. Thereafter, the central processing 
means 9 shifts to the step SP165 to obtain the result of 
comparison with the voice recognition information regis- 35 
tered previously in the user information management 
database 13B. When the positive result is obtained, the 
central processing means 9 shifts to the step SP166, 
upon identification as the correct user. 

Here, the central processing means 9 activates the *o 
speech synthesis means 1 1 and reports the result of 
comparison to a user. Here, result is reported to a user 
with the message "You are identified". Thereby, the cen- 
tral processing means 9 shifts to the step SP167 to start 
the service desired by a user and thereafter shifts to the 45 
step SP168 to complete this processing sequence. 

On the other hand, if voice recognition result does 
not match the registered voice recognition information, 
the central processing means 9 shifts to the step SP169 
to judge whether the mismatching result of the current so 
access is less than the preset specified number of times 
or not. When the positive result is obtained, the central 
processing means 9 shifts to the step SP162 to urge a 
user to input again the voice. Thereby, the means 9 
repeats the processing sequence of the step SP162- ss 
SP163-SP164-SP165-SP169-SP162 until the correct 
user can be identified within the range of the specified 
number of times. If matching cannot be obtained even 
after the comparison is repeated until the specified 
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number of times, the central processing means 9 judges 
that a user is not the correct user and shifts to the step 
SP170 from the step SP169. Here, the central process- 
ing means 9 reports the result of comparison and shifts 
to the step SP168 to complete this processing 
sequence. Here, the comparison result is reported to a 
user with the message "Access is impossible". 

Thereby, the server 1 can improve security by utiliz- 
ing the voice recognition. The central processing means 
9 executes user identification by the voice recognition, 
for a user whose voice recognition information is not yet 
registered, with reference to sex and age of user regis- 
tered in the user information management database in 
addition to the password number and ID input and reg- 
isters this voice recognition result as the voice recogni- 
tion information to improve security effect. 

Upon completion of user identification, the central 
processing means 9 executes the guide by voice to wait 
for an instruction from a user by operation of the opera- 
tor of the telephone terminal 5. Here, when a user 
inquires the number of electronic mails not yet read by 
operating the predetermined operator, the central 
processing means 9 executes the processing sequence 
of Fig. 40. 

Namely, the central processing means 9 shifts to 
the step SP176 from the step SP175 to obtain an 
instruction from a user and thereafter shifts to the step 
SP177 to retrieve the number of electronic mails not yet 
read. Thereafter, the central processing means 9 shifts 
to the step SP178 to activate the speech synthesis 
means 11 or recording and reproducing means 12 to 
report the electronic mails not yet read from the speech 
synthesis means 11 or recording and reproducing 
means 12. Thereafter, the central processing means 9 
shifts to the step SP179 to complete this processing 
sequence. Thereby, the server 1 is capable of checking 
the number of electronic mails not yet read even with 
the telephone terminal. 

In the case of offering the service as explained 
above, when a user operates the predetermined opera- 
tor, the central processing means 9 executes the 
processing sequence shown in Fig. 41 to notify by voice 
the current available services. Namely, the central 
processing means 9 shifts to the step SP181 from the 
step SP180 to obtain an instruction from a user and 
thereafter shifts to the step SP182. Here, the central 
processing means 9 interrupts the service being offered 
and shifts to the step SP183 to detect the kinds of serv- 
ices which can be presented to user. 

Subsequently, the central processing means 9 
shifts to the step SP184 to activate the speech synthe- 
sis means 1 1 or recording and reproducing means 12 in 
order to notify by voice the services which may be pre- 
sented in current. Here, the message "The functions 
which may be presented now are retrieval of electronic 
mail conditions, report of number of electronic mails 
retrieved, reading of subject of retrieval result, reading 
of main sentence of retrieval result, reading of electronic 
mails and end of this service." is sent to a user. Thereby, 
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a user who immediately wants to complete the services 
may complete the electronic mail service by notifying 
the completion of service depending on the guide. 
Thereby, the central processing means 9 sends a notice 
to a user as explained above and shifts to the step 
SP185 to complete this processing sequence. 

When a user instructs, in response to this notice, 
the retrieval of electronic mail conditions by operating 
the operator, the central processing means 9 executes 
the processing sequence of Fig. 42. Namely, the central 
processing means 9 shifts to the step SP191 from the 
step SP190 to urge a user to input by voice the retrieval 
condition. This retrieval condition is previously 
instructed with the guide by voice to be selected from 
the predetermined keywords and thereafter shifts to the 
step SP193 to accept this retrieval condition by recog- 
nizing the voice of user through voice recognition in the 
voice recognition means 10. 

Thereafter, the central processing means 9 shifts to 
the step SP194 to retrieve the electronic mails not yet 
read stored in the external memory apparatus 13 in 
view of counting the number of electronic mails arrived 
today, when a user inputs, for example, the keyword 
"Today". Subsequently, the central processing means 9 
shifts to the step SP195 to activate the speech synthe- 
sis means 1 1 or recording and reproducing means 12 to 
report by voice the retrieval report and thereafter shifts 
to the step SP196 to complete this processing 
sequence. 

After the electronic mails are retrieved as explained 
above, when a user instructs reading of the electronic 
mails, the server 1 reads the electronic mails retrieved 
by speech synthesis. Some electronic mails are not 
always required to be immediately checked by contents. 
Moreover, a certain period of time is required to read by 
voice the electronic mails. 

Fig. 43 is a flowchart showing the processing 
sequence of the central processing means 9 for retriev- 
ing, depending on the instruction of a user, the number 
of electronic mails which are considered important by a 
user. Namely, in the case of the electronic mails having 
the contents to be notified immediately to a destination 
user, the content tends to be shortened. The electronic 
mail having a longer content requires a longer time for 
reading and has a demerit that content cannot be 
understood easily depending on the quality of voice. 

Therefore, the central processing means 9 shifts, 
when a user selects this service, to the step SP201 from 
the step SP200 to obtain an instruction from a user. 
Moreover, the central processing means 9 shifts to the 
step SP202 to retrieve the number of electronic mails 
not yet read. The central processing means 9 shift, 
thereafter, to the step SP203 to reset the counter value 
i to zero (0) and then shifts to the step SP204. 

Here, the central processing means 9 judges 
whether the counter value i is smaller or not than the 
number of mails detected in the step SP202. When the 
positive result is obtained, the central processing 
means 9 shifts to the step SP205 to count the number of 



761 A2 




characters of the main sentence of the electronic mails 
not yet read corresponding to the counter value i. 

In this embodiment, retrieval of electronic mails 
depending on the length is executed depending on 

5 selection by a user even when contents have the other 
data. In this case, when the electronic mails are formed 
of image data and a user requests the mail reading 
service, the server 1 executes the character recognition 
process and thereafter outputs the data after the 

10 speech synthesis in order to judge a rough number of 
characters from the amount of data in place of the accu- 
rate number of characters. Moreover, when the voice 
data is used and a user requests this mail reading serv- 
ice, the server 1 drives in direct the sound source to out- 

is put the voice data to judge, also in this case, a rough 
number of characters depending on the amount of voice 
data. 

Upon detection of the number of characters as 
explained above, the central processing means 9 shifts 

20 to the step SP206 to judge whether the number of char- 
acters is less than the preset specified number or not. If 
negative result is obtained, it shifts to the step SP207 to 
remove this electronic mail from the candidate to be 
notified to a user and thereafter shifts to the step 

25 SP208. On the other hand, when a positive result is 
obtained in the step SP206, the central processing 
means 9 shifts to the step SP209 to register this mail as 
the candidate to be notified to a user and thereafter 
shifts to the step SP208. 

30 In the step SP208, the central processing means 9 
increments the counter value i and thereafter returns to 
the step SP204. Thereby, the central processing means 
9 repeats, for all electronic mails not yet read destined 
to a user, the processing sequence of the steps SP204 

35 - SP205 - SP206 - SP207 - SP208 - SP204 or the steps 
SP204 - SP205 - SP206 - SP209 - SP208 - SP204 to 
detect the electronic mails in the number of characters 
less than the specified number. Moreover, for all elec- 
tronic mails not yet read destined to a user, the central 

40 processing means 9 executes this series of processing 
sequence. Thereby, when a negative result is obtained 
in the step SP204, the central processing means 9 
shifts to the step SP21 0 to report by voice the number of 
mails detected here and thereafter shifts to the step 

45 SP2 1 1 to complete this processing sequence. 

Meanwhile, Fig. 44 is a flowchart showing the 
processing sequence of the central processing means 9 
for detecting the electronic mails closely related to a 
user depending on selection by user. Here, the central 

so processing unit 9 shifts to the step SP221 from the step 
SP220 to obtain an instruction from a user and then 
shifts to the step SP222 to retrieve the number of elec- 
tronic mails not yet read. Thereafter the central process- 
ing means 9 shifts to the step SP223 to set the counter 

55 value i to zero (0) and then shifts to the step SP224. 

In this step, the central processing means 9 judges 
whether the counter value i is less than the number of 
mails detected in the step SP222 or not If a negative 
result is obtained, the means 9 shifts to the step SP225 
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to extract the subject and originator information of t he 
electronic mails not yet read conesponding to the coun- 
ter value i. 

Subsequently, the central processing means 9 
shifts to the step SP226 to retrieve history of electronic s 
mails in the past stored in the record as many as the 
number of mails. Thereafter, the central processing 
means 9 shifts to the step SP227 to set the counter 
value j to zero and then shifts to the step SP228. Here, 
the means 9 judges whether the counter value j is less 10 
than the number of historical mails in the past retrieved 
in the step SP225 or not. When a positive result is 
obtained, the means 9 shifts to the step SP229. 

Here, the central processing means 9 judges 
whether destinations of the electronic mails in the past 15 
identified by the variable j matches the originators of the 
electronic mails not yet read identified by the variable i 
or not. When a negative result is obtained, the means 9 
shifts to the step SP230 to increment the counter value 
j and returns to the step SP228. Thereby, the central 20 
processing means 9 repeats, for the electronic mails not 
yet read identified by the variable i. the processing 
sequence of the step SP228 - SP229 - SP230 - SP228 
to judge whether the mails not yet read identified by the 
variable i are originated by the same originator who 25 
have issued the predetermined number of mails in the 
past or not. 

Here, if the electronic mails are not issued by the 
same originator who has issued the mails in the past, 
the positive result cannot be obtained even after this 30 
processing sequence is repeated for the predetermined 
number of times equal to the number of mails. After all, 
the central processing means 9 obtains the negative 
result in the step SP228. Thereby, the central process- 
ing means 9 shifts to the step SP232 to increment the 35 
counter value i and thereafter shifts to the step SP224 to 
repeat the same process for the next electronic mail not 
yet read. 

Meanwhile, this electronic mail has been issued 
from the same originator of the mails received in the w 
past the central processing means 9 obtains the posi- 
tive result in the step SP229 and then shifts to the step 
SP231. Here, the central processing means 9 judges 
whether the subjects of the electronic mails in the past 
identified by the variable j matches the subjects of the 45 
mails not yet read identified by the variable i or whether 
the characters "Re:" or "RE:" are attached at the begin- 
ning of the subjects of the electronic mails not yet read 
identified by the variable i. Namely, it is accustomed for 
the electronic mails that a response mail regarding the so 
related item in the past must be returned with the same 
subject or the characters "Re:" or "RE:** must be added 
at the beginning of the response mail. 

Therefore, the central processing means 9 judges 
whether the electronic mail not yet read identified by the 55 
variable i is related to the mail in the past identified by 
the variable j. When a negative result is obtained, the 
means 9 shifts to the step SP230. On the other hand, 
when a positive result is obtained in the step SP231 . the 
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central processing means 9 shifts to the step SP233 to 
set the mail not yet read identified by the variable i as 
the candidate mail to be presented to a user and there- 
after shifts to the step SP232. 

Thereby, the central processing means 9 judges, for 
all electronic mails detected in the step SP222, judges 
whether these are closely related with a user or not and 
shifts, upon completion of this series of process to all 
electronic mails, to the step SP235, because a negative 
result is obtained in the step SP224, to report by voice 
the number of mails detected to a user and thereafter 
shifts to the step SP236 to complete this processing 
sequence. 

In this embodiment, in place of retrieval of mails 
depending on characters included in the subject line, 
the mail retrieval may also be executed depending on 
type of terminal, sex and age of originator and language 
used added to the subject of the mail. Therefore, the 
server 1 can improve the efficiency of retrieval by using 
such information added at the time of transmission of 
mail. 

Fig. 45 is a flowchart showing a processing 
sequence of the central processing means 9 for detect- 
ing an electronic mail which is judged by an originator to 
be notified urgently depending on selection by a user. 
Here, the central processing means 9 shifts to the step 
SP241 from the step SP240 to obtain an instruction 
from a user and thereafter shifts to the step SP242 to 
retrieve the number of mails not yet read. Subsequently, 
the means 9 shifts to the step SP243 to set the counter 
value i to zero and then shifts to the step SP244. 

Here, the central processing means 9 judges 
whether the counter value i is less than the number of 
mails detected in the step SP242 or not and shifts, upon 
obtaining a positive result, to the step SP245 to judge 
whether a term "urgent" is included or not in the main 
sentence of the electronic mail not yet read correspond- 
ing to the counter value i. When a positive result is 
obtained, the central processing means 9 shifts to the 
step SP247 to set the mail identified by the variable i as 
the candidate mail to be presented to a user and there- 
after shifts to the step SP248. If, on the other hand, a 
term "urgent" is not included in the main sentence, the 
central processing means 9 shifts to the step SP249, 
because a negative result is obtained in the step 
SP246, to remove the electronic mail not yet read iden- 
tified by the variable i from the candidate mails to be 
presented to a user and thereafter shifts to the step 
SP248. 

In the step SP248, the central processing means 9 
increments the counter value i and thereafter returns to 
the step SP244 to repeat the similar process to the next 
electronic mail no yet read. Thereby, the central 
processing means 9 judges whether the sill mails 
detected in the step SP242 include the term "urgent" or 
not. Upon completion of this series of process to all 
electronic mails, the means 9 shifts to the step SP250, 
because a negative result is obtained in the step 
SP244, to report by voice the number of mails detected 
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to a user and thereafter shifts to the step SP251 to com- 
plete this processing sequence. 

Fig. 46 is a flowchart showing the processing 
sequence of the central processing means 9 for retriev- 
ing the electronic mails with reference to the term previ- s 
ously registered by a user depending on selection by a 
user. In the central processing means 9, individual key- 
words of a user can be registered for each kind to the 
user information management database through voice 
recognition and access from a computer 4. As the key- 10 
word for retrieval of this kind, the terms which are con- 
sidered to be necessary in common to the other users 
are held in each kind in the external memory apparatus 
13. 

In this embodiment, a user is recommended, by is 
preceding registration, to assign "No. 1" to an urgent 
kind of mail and also assign the keywords "urgent, 
emergency, quick" to this kind of mail and to assign "No. 
2" to a business mail and also assign the keywords 
"business, job, work" to this kind of mail. Moreover, a 20 
user is recommended to assign "No.3" to a personal 
mail and also assign the keyword of a personal name, 
for example, Tanaka" to this kind of mail. In regard to 
the term considered to be necessary in common to 
other users, a plurality of keywords are assigned to 25 
each kind of mail. 

In this processing sequence, the central processing 
means 9 shits to the step SP271 from the step SP270 to 
obtain an instruction from a user and thereafter shifts to 
the stop SP272 to urge a user to input a keyword and 30 
thereafter shifts to the step SP273 to accept an instruc- 
tion from a user. Here, the central processing means 9 
accepts an instruction to retrieve the electronic mails 
with any keyword of the term considered to be neces- 
sary in common to users, the term individually regis- 35 
tered by a user or the term input by a user through the 
voice recognition and sequentially accepts the corre- 
sponding kind. 

When a user has selected a term registered individ- 
ually, the central processing means 9 accepts the kind 40 
which a user desires with the guide by voice and sets 
the term of this kind as the keyword. When a term con- 
sidered to be necessary in common to users is also 
selected, the central processing means 9 also accepts 
the kind which a user desires with the guide by voice 45 
and sets the term of this kind as the keyword. Mean- 
while, when a user has input a term by voice recogni- 
tion, the means 9 retrieves a synonym dictionary stored 
in the external memory apparatus 1 3 and sets the terms 
including synonyms as the keyword based on the result so 
of retrieval. 

When the keywords are set as explained above, the 
central processing means 9 shifts to the step SP274 to 
retrieve the number of electronic mails not yet read. 
Subsequently, the central processing means 9 shifts to ss 
the step SP275 to set the counter value i to zero and 
thereafter shifts to the step SP276. 

Here, the central processing means 9 judges 
whether the counter value i is less than the number of 
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mails detected in the step SP274 or not. When a posi- 
tive result is obtained, the means 9 shifts to the step 
SP277. The central processing means 9 sets the coun- 
ter value j to zero and thereafter shifts to the step SP278 
to judge whether the counter value j is smaller than the 
total number of keywords or not. When a positive result 
is obtained, the means 9 shifts to the step SP279 and 
retrieves the keyword identified by the counter value j 
from the main sentence of the electronic mail not yet 
read corresponding to the counter value i and then 
shifts to the step SP280. 

Here, the central processing means 9 judges 
whether the keyword identified by the counter value j 
exists in the main sentence of the electronic mail not yet 
read corresponding to the counter value i or not. When 
a negative result is obtained, the means 9 shifts to the 
step SP281 to increment the counter value j and then 
returns to the step SP278. Thereby, the central process- 
ing means 9 repeats, for each keyword, the processing 
sequence of step SP278 - SP279 - SP280 - SP281 - 
SP278 in regard to the electronic mail not yet read cor- 
responding to the counter value i to judge whether this 
keyword is included in the main sentence of the elec- 
tronic mail identified by the value i or not. 

In this case, when any keyword is not included in 
the main sentence of the mail identified by the value i, 
the central processing means 9 shifts to the step SP282 
from the step SP278 to increment the counter value i 
because it obtains a negative result in the step SP278 
by repeating this processing sequence for the number 
of times equal to the number of keywords and thereafter 
shifts to the step SP276. Thereby, the central process- 
ing means 9 changes the retrieval object of keyword to 
the next electronic mail not yet read. 

Meanwhile, when any keyword is included in the 
main sentence of the electronic mail identified by the 
value i, a positive result can be obtained in the step 
SP280 while a series of processing sequence is 
repeated. In this case, the central processing means 9 
shifts to the step SP283. Here, the means 9 sets the 
electronic mail identified by the counter value i to the 
candidate mails to be reported to a user and thereafter 
shifts to the step SP282 to increment the value i and 
returns to the step SP276. 

Thereby, the central processing means 9 repeats 
this processing sequence for the electronic mail not yet 
read identified by the variable i and shifts to the step 
SP284 to report by voice the number of mails detected 
to a user, because a negative result is obtained in the 
step SP276 upon completion of this processing 
sequence to the electronic mail not yet read detected in 
the step SP274 and thereafter shifts to the step SP285 
to complete this processing sequence. 

When a user operates the predetermined operator 
after the number of electronic mails is reported to a 
user, the central processing means 9 subsequently exe- 
cutes the processing sequence shown in Fig. 47. 

Here. Fig. 47 is a flowchart showing the processing 
sequence when a user has instructed reading of the 
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subject The central processing means 9 shifts to the 
step SP291 from the step SP290 to obtain an instruc- 
tion from a user and then shifts to the step SP292 to set 
the counter value i to zero and thereafter shifts to the 
step SP293. 5 

Here, the central processing means 9 judges 
whether the counter value i is smaller than the number 
of electronic mails detected in the process before this 
reading process. When a positive result is obtained, the 
means 9 shifts to the step SP294 to extract the subject w 
from the mail not yet read identified by the variable i. 
Subsequently, the central processing means 9 shifts to 
the step SP295 to convert the extracted subject into a 
voice signal through the speech synthesis in the speech 
synthesis means 11 and outputs this voice signal to a is 
user in the step SP296. Thereafter, the means 9 shifts 
to the step SP297 to increment the value i and returns 
to the step SP293. 

Therefore, the central processing means 9 sequen- 
tially repeats this processing sequence for the elec- 20 
tronic mail not yet read detected by the various retrieval 
processes explained above to notify by voice the subject 
sequentially. Thereafter, the central processing means 9 
shifts to the step SP298 to complete this processing 
sequence because a negative result is obtained in the 25 
step SP293 when this processing sequence is com- 
pleted for all detected mails not yet read. 

Fig. 48 is a flowchart showing the reading process 
of subject by the central processing means 9 when Eng- 
lish terms are included in the subject. In this case, the so 
central processing means 9 shifts to the step SP301 
from the step SP300 to obtain an instruction from a user 
and thereafter shifts to the step SP302 to set the coun- 
ter value i to zero and then shifts to the step SP303. 

Here, the central processing means 9 judges 35 
whether the counter value i is smaller than the number 
of mails detected in the process before this reading 
process and shifts, upon obtaining a positive result to 
the step SP304 to extract the subject from the electronic 
mail not yet read identified by the variable i. In succes- 40 
sion, the means 9 shifts to the step SP305 to judge 
whether this subject is formed of only alphabets or not 
from each character code forming the subject. When a 
positive result is obtained, the means 9 shifts to the step 
SP306 to read, by the recording and reproducing as 
means 12 or speech synthesis means 1 1 , the alphabets 
of the extracted subject character by character. Namely, 
when the subject is formed by the character string of 
"INFO.", the central processing means 9 reads "I, N, F ( 
O, Period". Therefore, the server 1 is capable of reading so 
the subject through the simplified speech synthesis. 
Subsequently, the central processing means 9 shifts to 
the step SP307 to increment the value i and then 
returns to the step SP303. 

When a negative result is obtained in the step ss 
SP305, the central processing means 9 shifts to the 
step SP308 to read the subject with the other method. 
Namely when this server 1 is installed in Japan, the 
subject formed of only Japanese, subject formed by 



combination of Japanese terms and English terms and 
subject formed by the relevant language when an origi- 
nator address is in the zone other than the English zone 
may be considered. Therefore, the central processing 
means 9 reads the subject through the speech synthe- 
sis as in the case explained in regard to Fig. 47 when 
the subject is formed of the Japanese terms. In other 
cases, the means 9 reads the subject in the relevant 
language in accordance with the kind of language 
added to the subject, depending on selection by user. 

Therefore, the central processing means 9 incre- 
ments the value i in the step SP307 and returns to the 
step SP303. Thereby, the means 9 repeats this 
processing sequence, for the electronic mail not yet 
read detected by the various retrieving processes 
explained above, to notify by voice the subject to a user 
and thereafter shifts to the step SP309 to complete this 
processing sequence because a negative result is 
obtained in the step SP303 when this processing 
sequence is completed for ail detected electronic mails 
not yet read. 

Fig. 49 is a flowchart showing the processing 
sequence of the central processing means 9 when a 
user has previously set the language identification 
mode. In this embodiment, this mode may be set by the 
preceding registration. 

Namely, the central processing means 9 shifts to 
the step SP311 from the step SP310 to obtain an 
instruction from a user and then shifts to the step SP312 
to set the counter value i to zero and shifts to the step 
SP313. 

Here, the central processing means 9 judges 
whether the counter value i is smaller than the number 
of electronic mails detected in the process before this 
reading process or not and shifts to the step SP314 
upon obtaining a positive result to extract the subject 
from the mail not yet read identified by the variable i. 
Thereafter, the central processing means 9 shifts to the 
step SP315 to judge the language for the reading for 
each part of the subject from the character code forming 
the subject (An example of judgment is necessary.) 
Thereafter, the central processing means 9 shifts to the 
step SP316 to executes the speech synthesis for the 
subject depending on the result of judgment and then 
shifts to the step SP317 to connect the voices synthe- 
sized by languages to send the voice to a user in the 
step SP318. Thereby, the central processing means 9 
reads the subject, for example, 

"PATENT CO^f 

in such a manner that "PATENT" is read by the synthe- 
sized voice in English and 

is read by the synthesized voice in Japanese. 
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Thereby, the central processing means 9 reads the 
subject in the language considered adequate by the lan- 
guage recognition function of the server 1 and thereaf- 
ter increments the counter value i in the step SP31 9 and 
then returns to the step SP319. Moreover, the central 5 
processing means 9 shifts, upon completion of this 
series of processing sequence for the electronic mail 
not yet read detected by various retrieving processes 
explained above, to the step SP320 from the step 
SP3 1 3 to complete this processing sequence. ? 0 

On the occasion of reading the subject, the central 
processing means 9 is caused for the subject formed of 
the predetermined number or more number of charac- 
ters to read only the predetermined number of charac- 
ters from the beginning for the convenience of a user. 75 
Moreover, depending on registration of setting by a 
user, speech synthesis is switched to generated, for 
example, the voice of male or female for each mail to be 
read. Thereby, the end of electronic male can be natu- 
rally recognized. 20 

Fig. 50 is a flowchart showing a processing 
sequence executed wen a user instructs reading of the 
electronic mail by operating the operator after the above 
retrieval processing or reading of the subject In this 
processing sequence, the central processing means 9 25 
shifts to the step SP322 from the step SP321 to obtain 
an instruction from a user and then shifts to the step 
SP323 to set the counter value i to zero and then shifts 
to the step SP324. 

Here, the central processing means 9 judges 30 
whether the counter value i is smaller than the number 
of mails detected in the process before the mail reading 
process and shifts, upon obtaining a positive result, to 
the step SP325 to extract the main sentence of the mail 
not yet read identified by the variable i. Here, the central 35 
processing means 9 extracts only the predetermined 
number of characters from the beginning of the main 
sentence and shifts to the step SP326 to execute the 
speech synthesis of the extracted part and thereafter 
shifts to the step SP327 to output the synthesized voice 40 
to a user. 

Thereby, the central processing means 9 reads the 
predetermined number of characters of the contents of 
the main sentence and thereafter increments the coun- 
ter value i in the step SP328 and then returns to the step 45 
SP324. At the time of reading the main sentence 
through the speech synthesis, the central processing 
means 9 changes the reading voice, for example, from 
the voice of male or from the voice of female to the voice 
of male or female for the part enclosed in the signs "**. Q so 
and 0 in order to accurately notify the contents empha- 
sized in the main sentence by an originator. Moreover, 
since the predetermined number of characters from the 
beginning is read and thereafter the number of charac- 
ters read is reported by voice for the total number of ss 
characters of the main sentence, operation flexibility of 
user may be improved. 

When a user operates, while the mail is being read, 
the operator assigned to a skip, mail reading is once 
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interrupted and the subsequent electronic mail is read 
in the step SP328. On the contrary, when a user oper- 
ates the operator for continuously reading the mail, the 
main sentence following the number of characters 
extracted in the step SP325 is extracted and then output 
through the speech synthesis. Moreover, when a user 
operates the operator assigned for specifying the read- 
ing speed, the reading speed is changed in response to 
operation of the operator. Reading is executed word by 
word depending on the punctuation marks so that a 
user can easily recognize the contents of mail. 

In the case of the retrieving by keyword, the back- 
ground music corresponding to the keyword and kind 
used for this retrieval is played to reducing the waiting 
time of a user at the time of reading the main sentence. 
Also, in the case of reading this main sentence, voice 
can be changed for each electronic mail depending on 
the preceding registration and moreover, the language 
recognition function, etc. may also be used. In addition, 
it is possible to execute the setting so that speech syn- 
thesis is not effectuated to the idiomatic phrases at the 
beginning and end of the sentence used in the elec- 
tronic mail of this kind, department name, telephone 
number, facsimile apparatus number and electronic mail 
number, etc. Thereby, flexibility of use can be very much 
improved. 

Moreover, the central processing means 9 is capa- 
ble of effectively using the information added to the sub- 
ject line to execute the speech synthesis, depending on 
the preceding setting by a user, by voice of female for 
the mail received from a female user or by voice of male 
for the mail received from a male user and moreover 
executes the speech synthesis with the level of voice 
depending on age. In this case, the language used for 
speech synthesis depends on the language added to 
the subject 

The server 1 separately registers the electronic 
mail thus retrieved by combining such electronic mail 
reading process and the services by the MAM server 
explained previously and thereafter outputs the mails by 
transferring to the facsimile apparatus 6 and computer 
4, etc. 

(5) World Wide Web 

In this embodiment, when a user requests the 
World Wide Web service with the Gaia code or by des- 
ignation of address in an ordinary Internet, the central 
processing means 9 navigates this network to offer the 
service requested by a user. In this case, when a user 
has made an access from the computer 4 , the central 
processing means 9 offers the service requested by a 
user in the same manner as the server in the ordinary 
server. 

In addition, the server 1 also holds the information 
formed of the organically inter-related hyper-media to 
offer the World Wide Web service also from the tele- 
phone terminal 5. facsimile apparatus 6 and private ter- 
minal 15 and also offer such information in various 
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formats. 

Therefore, the server 1 holds, in the external mem- 
ory apparatus, the hyper-media sources shown in Fig. 
51 and Fig. 52. Here, this source is described in the for- 
mat that various codes are increased for the HTML s 
(Hyper Text Markup Language) format namely in the 
format realized by expanding the HTML format. There- 
fore, the server 1 transfers the source code held therein 
as required through the Internet. 

Namely, in Fig. 51 and Fig. 52, "(HEAD)" indicating 10 
initiation is described first and thereafter the text data 
indicating this server is described between "(TITLE)" 
and "< /TITLE )" indicating start and end of the title. 
Moreover, being enclosed by tags, "VOICE LANGUAGE 
= JAPANESE" indicating the process by Japanese Ian- 15 
guage is described, thereafter "SYNTH =" instructing 
speech synthesis of the object is described, followed by 
description of "Welcome to the O O O server" indi- 
cating the object of speech synthesis and "LEVEL=0" 
indicating the level of speech synthesis. Thereby, the 20 
part "Welcome to the O O O server" can be recog- 
nized as the object of speech synthesis from the 
description. 

Subsequently, after "< /TITLE)" is described, 
"VOICE BGM=" indicating reproduction of the back- 25 
ground music is described, "DRM#122" indicating the 
title of music is then enclosed by tags. With the descrip- 
tion explained above, the music enclosed by the sign 
is reproduced as the background music during the 
period of waiting for user's operation. 30 

Moreover, "(VOICE PAUSE=1) for providing a 
pause as long as the specified numeral in the speech 
synthesis output is described, followed by description of 
"<AHREF=7Welcome English.htmD English Page" of 
the text setting the link destination and anchor corre- 35 
spending to this link destination. Thereafter, "VOICE 
LANGUAGE=English SYNTH=" indicating the speech 
synthesis by English is also described with the descrip- 
tion of "English Page" indicating contents of speech 
synthesis and "LEVEL=0" indicating the level of speech 40 
synthesis. Thereby, the part "English Page" may be eas- 
ily recognized as the object of speech synthesis. 

Subsequently, after "RECOG" instructing voice rec- 
ognition is described with the description for specifying 
the process by English with description of "English 45 
Page" indicating the language to be recognized. There- 
after , it is also described for voice recognition of 

"7L ^ ZKT)^ — i/» 
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text 

In this embodiment, following this description, the 
source code displayed after "English Page" is 
described, and therefter contents are also described. 
Subsequently, the source code indicating the speech 
synthesis following "English Page" is described together 
with contents of speech synthesis to designate the 
period of pause of speech synthesis. 

Thereafter, in the case of this source (Fig. 52), the 
source code indicating display by text is described with 
the contents thereof "Item Guide" and subsequently 
speech synthesis by Japanese of "Guidance for Item" is 
described. Moreover, the pause of speech synthesis is 
designated and thereafter text "Car-Navi" is described 
with designation of link destination and speech synthe- 
sis and voice recognition by Japanese of "Car-Navi" are 
described. Thereafter, text "Headphone" is described 
with designation of the link destination and speech syn- 
thesis and voice recognition by Japanese of "Head- 
phone" are described in the same manner as the 
description of "Employment Information". 

Thereby, in this embodiment, reading by voice of 
home page from a telephone terminal can be made and 
in this case, various pieces of information may be 
offered like an ordinary home page for the access from 
a computer. 

Namely, Fig. 53 is a flowchart showing access to 
the home page by an ordinary WWW browser. In this 
case, the browser shifts to the step SP341 from the step 
SP340 to read the source and then shifts to the step 
SP342 to interpret each line. Subsequently, the browser 
shifts to the step SP343 to judge whether the command 
may be interpretd or not and shifts, upon obtaining a 
positive result, to the step SP344. Here, the browser 
displays contents in accordance with the command and 
shifts to the step SP345 but shifts in direct, upon obtain- 
ing a negative result to the step SP345. 

In this step SP345. the browser judges whether the 
line is the final line or not and returns, upon obtaining a 
positive result, to the step SP342. But when a negative 
result is obtained, the browser shifts to the step SP346 
to complete this processing sequence. Thereby, in the 
browser of this type which cannot recognize by voice 
the source code as explained with reference to Fig. 51 
and Fig. 52, the contents where the source code is 
added by voice is omitted from the display and the con- 
tents shown in Fig. 54 is displayed. The underlined part 
indicates the linked area. 

(5-1) Access by telephone terminal 



by Japanese. Thereby, in this source, navigation to 
Welcome_English.html as the link destination is possi- 
ble with the voicing of "English Page" or 

55 

and with designation of "English Page" farmed of the 



Fig. 55 is a flowchart showing a processing 
sequence of the private central processing means 9 
holding the browser to interpret this source. When the 
server 1 is accessed from a telephone terminal or a tel- 
ephone terminal incorporated to the facsimile apparatus 
6 and when a user has selected the service by voice by 
making access to the server 1 from a private terminal 
15, the central processing means 9 executes this 
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processing sequence. 

Namely, the browser shifts to the step SP351 from 
the step SP350 to read the source. Thereafter, the 
browser shifts to the step SP352 to interpret each line 
and thereafter judges, in the step SP353. whether the 
command of voice processing exists or not in the line 
interpreted in the step SP353. When a negative result is 
obtained, the browser shifts to the step SP354 to judge 
whether the line is the final line or not and thereafter 
returns, upon obtaining a negative result in the step 
SP354, to the step SP352. 

Meanwhile, when the voice processing command is 
included, since a positive result is obtained in the step 
SP353. the browser shifts to the step SP355. Here, the 
browser starts flat setting process depending on the 
option set in the interpreted voice processing command. 
Namely, the browser interprets the language in the sub- 
sequent step SP256. If the language is not preset, voice 
processing is executed by the language used in current. 
When the language is preset, the browser sets the cor- 
responding language to the language of processing 
object in the step SP357. 

In the subsequent step SP358, the browser judges 
the level. If the level is not preset, voice processing is 
performed in the current level. When the level setting is 
performed, the browser sets the processing object level 
to the corresponding level in the step SP359. 

Moreover, the browser judges whether voice recog- 
nition process is specified or not in the step SP360. If it 
is not preset, the voice processing is performed in the 
same manner. When the voice recognition is preset, 
terms for voice recognition are added in the step 
SP361. 

The browser judges, in the step SP362. whether 
speech synthesis process is specified or not. If it is not 
yet specified, the speech synthesis is executed in the 
same manner and when it is specified, the browser exe- 
cutes the speech synthesis for the corresponding 
description in the step SP363. 

Moreover, the browser judges, in the step SP364, 
existence of description of pause. If it is not yet speci- 
fied, the browser shifts to the step SP366. but when it is 
specified, the browser sets the corresponding pause 
period in the step SP365 and then shifts to the step 
SP366. In this step SP366, the browser judges whether 
instruction for the background music is described or not. 
When a negative result is obtained, the browser shifts to 
the step SP354 but wen a positive result is obtained, the 
browser reproduces the music specified in the step 
SP367 and then shifts to the step SP354. 

Thereby, the server 1 corresponding to the 
expanded HTML format sequentially executes only the 
commands in relation to the voice processing and when 
it reaches the final line, it shifts to the step SP368 from 
the step SP354 to complete this processing sequence. 
Therefore, in this case, the services of the contents 
shown in Fig. 56 are offered by voice in the telephone 
terminal 5. the telephone terminal incorporated to the 
facsimile apparatus 6 and the private terminal 1 5. In Fig. 



56, contents enclosed by the tags ar ? formed of the 
contents where the link is preset. Therefore, the server 
1 is caused to execute the speech synthesis by chang- 
ing the voice at the part enclosed by the tags in view of 

5 urging user*s attention. Accordingly, when the terms 
shown in Fig. 57 are voiced, voicing of terms is voice 
recognized and is then navigated to the corresponding 
link destination. 

As explained above, a couple of portions may be 

w described in parallel to form a source by identifying the 
portion for offering information by the text data and the 
portion for offering information by voice and thereby the 
time required for generation of source can drastically be 
shortened in comparison with the case where the 

15 source offered by the text and the source offered by 
voice are formed individually. 

Moreover, when the portion corresponding to the 
headline of this source is described hierarchically, navi- 
gation to this hyper-media of this kind can be realized 

20 easily and reliably by voice or by display of text and the 
information of this kind can be used so far effectively 
and easily. 

Fig. 58 is a flowchart showing navigation of link 
destination by voice recognition in the server 1 . In this 

25 processing sequence, the central processing means 9 
shifts to the step SP381 from the step SP380 and shifts, 
when a user has accessed to the server 1 from the tele- 
phone terminal 5 or the telephone terminal incorporated 
to the facsimile apparatus 6 and selects the service by 

30 voice by making access to the server 1 from a private 
terminal 15, to the step SP382 to execute user identifi- 
cation by voice as in the case of electronic mail service 
by voice or to identify a user by detecting ID and pass- 
word number input by operation of operator with the 

35 DTMF signal. 

Subsequently, the central processing means 9 
extracts, in the step SP385, the linked area from the 
description of source assigned to this page. Thereby, in 
the source explained above in regard to Fig. 51 and Fig. 

40 52, the area enclosed by the tags explained above in 
regard to Fig. 56 is extracted. 

Thereafter, the central processing means 9 
sequentially repeats, in the step SP386, the processing 
loop explained above in regard to Fig. 55 to present the 

46 page contents through the speech synthesis and then 
waits for an instruction from a user. In this case, the cen- 
tral processing means 9 changes the voice at the linked 
area for speech synthesis of page contents. 

Namely, the server presents, in the step SP386, 

so various voices to urge a user to select a kind of voice 
when a user selects the service by speech synthesis. 
When a user selects an ordinary speech synthesis, the 
central processing means 9 executes the speech syn- 
thesis by voice of male for the ordinary portion or by 

55 voice of female for the linked area. When a user selects 
the other speech synthesis, the means 9 executes the 
speech synthesis by lower voice of male or female for 
the ordinary portion or by higher voice of male or female 
for the linked area. Moreover, when a user specifies 
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quality and level of voice, the speech synthesis is per- 
formed by changing the voice at the linked area and the 
other portion with the voice customized by this user. 

After page contents are guided by voice and a user 
voices the words of the linked area to which a user s 
wants to make access in the step SP387, the central 
processing means 9 shifts to the step SP388 to recog- 
nizes this voice to recognize the words designated by 
user. In this case, if accurate voice recognition is diffi- 
cult, and if a user does not voice the corresponding 10 
words, the central processing means 9 urges again a 
user to input the voice after the predetermined time has 
passed. 

Thus, upon recognition of words voiced by user, the 
central processing means 9 shifts to the step SP384 to is 
make access to the designated page to repeat this 
series of processing sequence in view of offering, as 
required, various pieces of information organically inter- 
related. 

In this embodiment the central processing means 9 20 
voices the linked words shown in Fig. 57 together with 
numerals, on the occasion of urging a user to designate 
by voice the link destination, and thereafter detects 
operation of the operator corresponding to this numeral 
with the DTMF signal and thereby to navigate the link 25 
destination with the operation of the operator of the tel- 
ephone terminal, etc. in place of the voice recognition. 

Fig. 59 is a flowchart showing a processing 
sequence for navigation of the link destination with this 
DTMF signal. In this processing sequence, the central 30 
processing means 9 shifts to the step SP391 from the 
step SP390 and thereafter shifts, when a user makes 
access to the central processing means 9 from the tele- 
phone terminal 5 and from the telephone terminal incor- 
porated to the facsimile apparatus 6 and when a user 35 
makes access to the central processing means 9 from a 
private terminal 15 to select the service by voice, to the 
step SP392 to identify the user by voice as in the case 
of the electronic mail service by voice or identify the 
user by detecting ID and password number input by the 40 
operation of the operator with the DTMF signal. 

Subsequently, the central processing means 9 
offers by voice the kind of services with the numerals to 
urge a user to select the desired service. When a user 
operates the operator corresponding to access to the 46 
word wide web, the central processing means 9 then 
urges a user to designate the page and shifts, when a 
user selects the access page by operation of the opera- 
tor in the step SP398, to the step SP394 to make 
access to the page selected by the user. so 

Here, the central processing means 9 accepts, 
depending on selection by a user, designation of the 
page based the Gaia code or combination of the opera- 
tors of numerals "0 to 9, * and #" assigned to the tele- 
phone terminal. ss 

Subsequently, the central processing means 9 
extracts, in the step SP395, the linked area from the 
description of source assigned to this page and shifts to 
the step SP396 to sequentially add the numbers to the 



linked area as shown in Fig. 60. Moreover, the central 
processing means 9 offers by speech synthesis the 
page contents in the step SP397 for the speech synthe- 
sis of the linked part and the number assigned in the 
step SP396. 

Thereafter, the central processing means 9 waits 
for an instruction from a user and detects, when a user 
operates the operator corresponding to the fink destina- 
tion to be accessed, this operation with the DTMF signal 
in the step SP394 to make access to the corresponding 
page. Here, the central processing means 9 executes 
the speech synthesis by changing the voice as in the 
case of accepting the selection of user by the preceding 
voice recognition and thereby guides the user to the 
pages to be selected. 

Thereby, the server 1 can navigate the world wide 
web by operating the operator of the telephone terminal 
depending on the guide by voice. 

(5-1) Message dial utilizing web 

This server 1 is capable of registering voice and text 
of a user in the home page to offer the message dial 
service. Here, the central processing means 9 records 
the voice with a voice signal into the recording and 
reproducing means 12 corresponding to a kind of the 
terminal used for registration and also records such 
voice in the external memory apparatus 13 with the 
voice data of WAV format, etc. In addition, it is also 
recorded in the external memory apparatus 13 with the 
text data, image data and video data. Moreover, 
depending on a kind of the terminal for making access 
to the voice recorded as explained above, the recorded 
voice can be output in direct and can also be output as 
required through data conversion. 

When a message content is input by voice or by 
voice data of the WAV format from a terminal consisting 
of the computer 4, this message content is recorded in 
the recording and reproducing means 12 or external 
memory apparatus 13. When such message content is 
input by the text data, image data and video data, it is 
also recorded in the external memory apparatus 13. 
Meanwhile, when the message content is input by voice 
or image data from a terminal consisting of the facsimile 
apparatus 6, it is recorded in the recording and repro- 
ducing means 12 or external memory apparatus 13. 

On the other hand, when an inquiry is issued for the 
message from a terminal consisting of the computer 4, 
message content is output by the voice signal or voice 
data of WAF format or by the text data, image data, 
video data, depending on the format designated by a 
user. Moreover, when an inquiry is issued from a termi- 
nal consisting of the facsimile apparatus 6, the video 
data and text data are converted as required into the 
image data and are then output When the message 
content is formed of voice, it is converted into the text as 
required by the voice recognition and is then output. 

Meanwhile, when the message content is input by 
voice signal via the telephone terminal 5. telephone ter- 
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minal incorporated to the facsimile apparatus 6 and pri- 
vate terminal 15, this voice signal is recorded in the 
recording and reproducing means. When a message 
inquiry is issued from these apparatuses, the voice sig- 
nal is reproduced and output from the recording and 5 
reproducing means 12. When an inquiry content is text 
data, the text data is read by the speech synthesis and 
output depending on user's operation. 

Fig. 61 is a flowchart showing a communication 
sequence for registering a message in the message 10 
service by voice signal. Fig. 62 is a flowchart showing 
the continuous communication sequence of Fig. 61. 
Namely, the central processing means 9 waits for the 
calling in the step SP401 and starts in response to the 
calling by telephone when a user dials under this condi- 75 
tion by operating the operator of the telephone terminal 
5 in the step SP402. 

Thereafter, the central processing means 9 exe- 
cutes the user identification process to this terminal and 
presents, upon obtaining user identification, the selec- 20 
tion menu by speech synthesis or by reproduction of 
voice with the recording and reproducing means 12. 
Moreover, the central processing means 9 starts 
acceptance of destination in the step SP403 when a 
user selects registration service in he message dial in 25 
response to the selection menu. 

In this destination acceptance process, the central 
processing means 9 inquires, in the step SP404, an 
input method to a user with the Gaia code. When a user 
selects the input method with input of the Gaia code by 30 
operating the operator of the telephone terminal in the 
step SP405, the means 9 urges a user to input of desti- 
nation in the subsequent step SP406. When a user 
inputs the Gaia code indicating the destination, for 
example, by operating the operator of the telephone ter- 35 
minal in the step SP407 in response to this urge, the 
central processing means 9 starts acceptance of pass- 
word number in the step SP408. 

Here, the central processing means 9 urges, in the 
step SP409, a user to input the password number fol- 40 
lowing the guide by voice and thereafter retrieves, when 
a user inputs the password number by operating the 
operator of the telephone terminal in the step SP410 in 
response to this urge, the documents of world wide web 
designated by the destination to judge whether the input 4$ 
password number matches the registered password 
number or not 

When a mismatching result is obtained, the central 
processing means 9 notifies, by speech synthesis or 
reproducing the recorded contents, that message dial so 
contents cannot be registered because of mismatching 
of the password number and thereafter closes the line. 

On the other hand, when a matching result is 
obtained, the central processing means 9 starts accept- 
ance of contents in the step SP41 1 . For acceptance of ss 
the contents, the central processing means 9 requests, 
in the step SP412. a user to input the contents by noti- 
fying a message for urging a user to input the contents. 
In response to this operation, a user voices, in the step 
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SP413, contents of the message dial and thereafter 
notifies the end of input by operating, for example, the 
operator "#". 

When contents of message dial are input as 
explained above, the central processing means 9 
records this contents in the recording and reproducing 
means 12 in the step SP414. The central processing 
means 9 converts this voice, as required, into the voice 
data of WAV format, in place of the operation explained 
above, and records this voice data into the external 
memory apparatus 13. Moreover, the central process- 
ing means 9 generates or updates the page of home 
page adopted to the message dial in accordance with 
the contents of this voice and thereafter presents this 
information to a document and then notifies the end of 
registration to a user in the step SP41 5 to close the line. 

Meanwhile. Fig. 63 shows a processing sequence 
for making access to the contents of the message dial. 
This processing sequence is executed by the communi- 
cation sequence shown in Fig. 64 and Fig. 65. The proc- 
esses corresponding to Fig. 61 are designated by the 
common reference numbers through Fig. 63 to Fig. 65. 

Namely, the central processing means 9 shifts to 
the step SP401 from the step SP420 to wait for a call- 
ing. Under this condition, when a user shifts to the step 
SP402 from the step SP421 to dial by operating the tel- 
ephone terminal incorporated to the facsimile appara- 
tus, the central processing means 9 starts operation in 
response to the calling by the telephone. 

Thereafter, the central processing means 9 exe- 
cutes the user identification process to the terminal and 
thereafter presents the selection menu by voice and 
then starts the acceptance of destination in the step 
SP403 when a user selects the contents check service 
in the message dial. 

For acceptance of destination, the central process- 
ing means 9 inquires by voice the input method in the 
step SP404 and urges a user to input of destination in 
the subsequent step SP406 (Fig. 65) when a user 
selects the input method, for example, with the input of 
Gaia code in the step SP405. When a user inputs the 
Gaia code indicating the destination, for example, with 
operation of the operator in the step SP 407, the central 
processing means 9 starts the acceptance of the pass- 
word number in the step SP408. 

Here, the central processing means 9 urges a user 
to input the password number following the guide by 
voice in the step SP409 and retrieves, when a user 
inputs the password number by operating the operator 
in the step SP410 in response to this urge, the docu- 
ments of world wide web designated by the destination 
in order to judge whether such input password number 
matches the registered password number or not 

When a mismatching result is obtained, the central 
processing means 9 notifies, by speech synthesis or by 
reproducing the recorded contents, that contents of 
message dial cannot be opened because of mismatch- 
ing of the password number and thereafter closes the 
line. 
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Meanwhile, when a matching result is obtained, the 
central processing means 9 reproduces, in the steps 
SP423 and SP424, the registered contents in response 
to user's operation to instruct extraction of contents in 
the step SP422. When contents are recorded in the 5 
recording and reproducing means 12, the central 
processing means 9 outputs reproduced contents. 
When, on the other hand, contents are stored in the 
external memory apparatus 1 with the voice data of 
WAV format or with the voice data of WAF format w 
obtained by making access to the other server, this 
voice data is converted into the voice signal and is then 
output. 

Meanwhile, contents are formed of the text data, 
contents are read by the speech synthesis. In this case. 15 
when the contents include image data and video data, 
the central processing means 9 notifies by voice the fact 
to a user. 

When message contents are offered by voice as 
explained above, a user closes the line in the step 20 
SP425 and then shifts to the step SP426 to complete 
this processing sequence. On the other hand, the cen- 
tral processing means 9 also closes the line in the step 
SP427 and thereafter shifts to the step SP428 to com- 
plete this processing sequence. 25 

Thereby, the server 1 is capable of offering the 
message dial service by effectively utilizing the Internet. 

(5-2) Transmission and reception of message data by 

the facsimile apparatus: 30 

Fig. 66 is a flowchart showing the processing 
sequence for registering image data by making access 
to the world wide web from he facsimile apparatus 6. In 
this processing sequence, the image data by the fac- 35 
simile apparatus 6 is registered by the communication 
sequence shown in Fig. 67 and Fig. 68. 

In this case, the central processing means 9 
accepts input of destination, etc. with the processing 
sequence similar to that explained above in regard to 40 
Fig. 61 to Fig. 65 with the telephone terminal incorpo- 
rated to the facsimile apparatus 6. Thereby, the 
processing sequence similar to that explained in regard 
to Fig. 61 to Fig. 65 is designated by the similar refer- 
ence codes in Fig. 67 and Fig. 68. 45 

Namely, the central processing means 9 shifts to 
the step SP410 from the step SP420 to wait for a calling 
and then starts its operation in response to a telephone 
calling when a user shifts, under this condition, to the 
step SP402 from the step SP421 to dial by operating the so 
operator of the telephone terminal 5. 

Thereafter, the central processing means 9 exe- 
cutes the user identification process to this terminal and 
thereafter presents the selection menu and starts 
acceptance of destination in the step SP403 when a ss 
user selects the content registration service in the mes- 
sage dial. 

For acceptance of the destination, the central 
processing means 9 inquires by voice the input method 



in the step SP404 and urges a user to input a destina- 
tion in the subsequent step SP406, when a user selects, 
in the step SP405, the input method, for example, by 
depressing the operator having the number correspond- 
ing to the menu, The central processing means 9 reads 
the destination menu by means of the speech synthesis 
and thereafter issues the menu selection request to a 
user. When a user input the destination by selecting the 
menu, for example, by operating the operator in 
response to this request, the central processing means 
9 starts acceptance of the password number in the step 
SP408. 

Here, the central processing means 9 urges a user 
to input of the password number following the guide by 
voice in the step SP409 and thereafter retrieves, when a 
user inputs the password number by operation of the 
operator in the step SP410 in response to above proc- 
ess, the documents of world wide web designated by 
the destination to judge whether the input password 
matches the registered password or not. 

When a mismatching result is obtained, the central 
processing means 9 notifies the fact by the speech syn- 
thesis and then closes the line. But, a matching result is 
obtained, the central processing means 9 starts accept- 
ance of contents in the step SP41 1. For acceptance of 
the contents, the central processing means 9 sends a 
message urging a user to input of the contents to 
request input of the contents in the step SP412. In 
response to this process, a user operates the operator 
for transmission regarding a document set to the fac- 
simile apparatus 6 to transmit the image of this docu- 
ment in the step SP430 by operating the operator for 
transmission. 

When contents of message dial is input by image 
as explained above, the central processing means 9 
records the contents to the external memory apparatus 
13 in the step SP431. In this case, the central process- 
ing means 9 converts an image of this image data into 
the image data of the JPEC format and records this 
image to the external memory apparatus 13 by com- 
pressing the amount of data. Moreover, in this case, the 
central processing means 9 generates and updates the 
page of the home page to be adopted to the message 
dial corresponding to this image data and then presents 
this information to the document 

Moreover, the central processing means 9 adds, 
prior to transmission of the image data of this type, the 
header information (telephone number, name and 
department of an originator) transmitted from the fac- 
simile apparatus 6 and then records this information or 
holds it to the document so that it can use this informa- 
tion for sorting and retrieval of image data. The central 
processing means 9 also records the sex of a user 
obtained by making access to the user information man- 
agement database 13B to use it for classification and 
retrieval. 

Upon completion of these processes, the central 
processing means 9 notifies a user the end of registra- 
tion and closes the line in the step SP415 and thereafter 
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shifts to the step SP428 to complete this processing 
sequence. Meanwhile, a user closes the line in the step 
SP425 in response to this notice and then shifts to the 
step SP426 to complete this processing sequence. 

For the inquiry to message from a terminal consist- 
ing of the facsimile apparatus, a user executes the user 
identification and checks existence of image registered 
following the guide by voice obtained through the tele- 
phone terminal incorporated to the facsimile apparatus 
to designate the menu for extracting the contents by 
designating the page of image data. For this user's des- 
ignation, the central processing means 9 converts the 
image data recorded by the JPEG format into the origi- 
nal image data and also converts the image data regis- 
tered in the other format by a terminal such as computer 
into the image data corresponding to the facsimile 
apparatus to transmit this image data. 

Thereby, the server 1 assures access to the world 
wide web also from the facsimile apparatus. 

(6) Book mark service , charging service 

(6-1) Book mark service 

The server 1 also implements book mark service 
and charging service in separation. Fig. 69 is a block 
diagram showing the peripheral structure of the server 1 
used for these book mark and charging services, etc. 

Namely the server 1 makes access to the name 
server 30 and resources 31 A, 31 B via the Internet 2 and 
thereby a user designates the corresponding address 
for each access. Namely, a user is required each time to 
input the complicated address. Therefore, the server 1 
can register the book mark to the user information man- 
agement database 13B explained above in regard to 
Fig. 1 and therefore can access easily without inten- 
tional input of address for the pages previously regis- 
tered using this book mark to originate the electronic 
mail and moreover use the message dial. 

Fig. 70 is a flowchart shoeing the book mark regis- 
tration service when a user makes access from a tele- 
phone terminal. In this case, the central processing 
means 9 is activated by a telephone call from a user to 
execute the user identification process and then urge a 
user to select the service. Here, after selecting the 
access to the world wide web, a user shifts to the step 
SP441 from the step SP440 to designate the page to be 
accessed. In this timing, the central processing means 9 
shifts to the step SP442 to make access to the desig- 
nated page. Subsequently, the central processing 
means 9 presents contents of the page accessed in the 
step SP443. 

Thereby, a user receives contents of the presented 
page in the step SP444 to navigate the world wide web 
by designating the linked words. As explained above, 
when a user voices "book mark" in the step SP445 
under the condition that the page desired by a user is 
presented or when a user operates the operator, for 
example, T for designating the book mark, the central 



processing means 9 detects this voice by the voice rec- 
ognition in the step SP446 or detects operation of this 
operator with the DTMF signal to enter the book mark 
registration mode. 

5 In this case, since recognition error of voice due to 
operation error of a user may be thought, the central 
processing means 9 urges a user to check the operation 
and enters the book mark registration mode, upon com- 
pletion of check. 

10 In the book mark registration mode, the central 
processing means 9 shifts to, the step SP447 to urge a 
user to pronounce the book mark name. In response to 
this urge, when a user pronounces, for example, 
"OOO server" in the step SP448, the central 

15 processing means 9 acoustically analyzes this pronun- 
ciation in the step SP449 and registers the result of 
acoustic analysis in the user information management 
database 13B corresponding to the page being pre- 
sented now. In this case, the central processing means 

20 9 registers this acoustic analysis result as the voice 
template to be used for voice recognition for the later 
access. The central processing means 9 holds in direct 
the voice as required to use it as the voice template. 
Moreover, in this registration process, the central 

25 processing means 9 notifies a user the voice recogni- 
tion result, for example, with address for identifying the 
page being presented now and thereby executes the 
book mark registration after obtaining the answer for 
acknowledgment from a user. 

30 Subsequently, the central processing means 9 
shifts to the step SP450 to send a notice indicating the 
end of registration to a user and then shifts to the step 
SP451 to complete this processing sequence. 

During a series of book mark registration, when a 

35 user designates an input method of the book mark proc- 
ess, the central processing means 9 detects the opera- 
tor operated by a user with the DTMF (Dual Tone Mufti 
Frequency) signal in place of the voice of user by the 
voice recognition to register the number corresponding 

40 to the operator and the page being presented now into 
the user information management database 13B. 

Moreover, when a user makes access from the tel- 
ephone terminal incorporated to the facsimile apparatus 
6, the central processing means 9 executes the book 

45 mark registration process with the voice recognition or 
operation of the operator. Moreover, in this case, as 
shown in Fig. 71, the book mark registration process 
can also be executed by the facsimile apparatus 6 
depending on selection by user, in addition to registra- 
nt? tion explained above. 

Namely, the central processing means 9 guides by 
voice a user to input the book mark name correspond- 
ing to the address by writing and sends message urging 
transmission of image data to a user, when a user 

55 selects book mark registration by the facsimile appara- 
tus 6 in the book mark registration mode. In response to 
this process, a user shifts to the step SP461 from the 
step SP460 to transmit a document writing in parallel 
the address (URL: Uniform Resource Locator) of the 
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page to be registered and the book mark name from the 
facsimile apparatus 6. Thereby, the central processing 
means 9 executes the character recognition process by 
the character recognition means 14 in the step SP462 
to obtain the address and book mark name written in 5 
the document. 

Subsequently, the central processing means 9 reg- 
isters, in the step SP463, the address and book mark 
name to the user information management database 
1 3B and thereafter shifts to the step SP464 to complete 10 
this processing sequence. In this case, the central 
processing means 9 notifies the address and corre- 
sponding book mark name of text data format obtained 
by character recognition to a user by the speech synthe- 
sis and thereby registers the address and book mark 15 
name after obtaining acknowledgment of user. 

Thereby, the server 1 can register the book mark 
with the facsimile apparatus. 

In this embodiment, the central processing means 9 
executes, when accessed from the computer, the book 20 
mark service similar to that offered by an ordinary 
browser. In this book mark service, the book mark is 
registered in the user information management data- 
base 13B, like the book mark service in the telephone 
terminal, etc. as explained above, and the book mark 25 
registered for only a person may be used as required in 
the different terminals. Thereby, this server can easily 
and surely make access, also from the telephone termi- 
nal at the distant area, to the page which is usually 
accessed from the computer 4 used at the home by a 30 
user and moreover can check contents of the page by 
making use of the service by voice. 

Namely, Fig. 72 is a flowchart showing a processing 
sequence of the book mark process when access is 
made from the telephone terminal 5 and telephone ter- 35 
minal incorporated to the facsimile apparatus 6 and 
when access is made by selecting the voice serve with 
the private terminal 15. 

In this case, the central processing means 9 is acti- 
vated when a user shifts to the step SP471 from the 40 
step SP470 to connects the line to the means 9 and 
executes the user identification process in the step 
SP472. When a user pronounces the voices for book 
mark access in the step SP473 after the user identifica- 
tion process is completed, or the selection menu is 45 
being presented by voice to a user and moreover when 
various pages are introduced by voice, the central 
processing means 9 detects pronunciation of these 
voices by voice recognition in the step SP474. 

In the subsequent step SP475, the central process- so 
ing means 9 outputs by speech synthesis a message 
urging input of the book mark name and then waits for 
an input from a user. In this case, the central processing 
means 9 notifies, depending on designation by user by 
operation of operator or by voice, the registered book 55 
mark together with the corresponding address. 

In the subsequent step SP475, the central process- 
ing means 9 outputs by speech synthesis, in the step 
SP475, a message urging input of the book mark name 
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and thereafter waits for input from a user. In this case, 
the central processing means 9 notifies by voice the 
registered book mark together with the corresponding 
address depending on designation by user by operation 
of operator or by voice 

In response to this process, when a user pro- 
nounces, for example, the book mark name 'O O O 
server" in the step SP476, the central processing 
means 9 detects, in the step SP477, the words pro- 
nounced by the voice recognition to retrieve the corre- 
sponding address. This voice recognition process is 
executed using the voice registered in the user informa- 
tion management database or voice template obtained 
by the acoustic analysis result and thereby the central 
processing means 9 detects the registered correspond- 
ing voice recognition result and the address corre- 
sponding to this voice recognition result. Moreover, 
when the book mark names obtained by character rec- 
ognition of the image data are registered in the user 
information management database, the corresponding 
address is detected by the voice recognition process 
with reference to the text data which has been con- 
verted previously and registered. 

Subsequently, the central processing means 9 noti- 
fies by voice the voice recognition result and address 
data to a user and makes access to the corresponding 
page in the step SP478, upon obtaining acknowledg- 
ment of user by operation of the operator or by voice 
and thereafter shifts to the step SP479 to complete this 
process. 

When a user selects by operation of the operator or 
by voice the input of book mark by operator in the 
access by the book mark, the central processing means 
9 detects the operator operated by a user with the 
DTMF signal in place of the book mark by the voice rec- 
ognition and also detects the number corresponding to 
this operator and address of the corresponding page 
from the user information management database to 
make access to this detected page after waiting for 
check by a user. 

Thereby, the server 1 can easily and surely make 
access to the page registered previously by means of 
the book mark name even with operation of the operator 
of the telephone terminal. 

The central processing means 9 accepts, when a 
user has made access from the facsimile apparatus, 
designation of book mark access with the input by oper- 
ation of the operator or by voice and executes the char- 
acter recognition process to the image data input 
subsequently as in the case of the book mark registra- 
tion to transmit contents of the corresponding page with 
the image data. 

When a user only transmits a document to the 
server 1, depending on the preceding registration by 
user, without selection of any service, the central 
processing means 9 executes the user identification 
process through communication with the facsimile 
apparatus before the start of transmission and offers 
here the book mark access service to user. Namely, the 
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central processing means 9 omits selection of service 
by means of the telephone terminal incorporated to the 
facsimile apparatus 6 and detects the book mark name 
written in the document through the character recogni- 
tion to make access to the corresponding page. Moreo- 5 
ver, the central processing means 9 converts the video 
data and text data of this page to the image data corre- 
sponding to the facsimile apparatus 6 to transmit this 
image data. 

Thereby, the server 1 can offer, for example, the 10 
particular news, etc., for the access from the facsimile 
apparatus, by the simplified operation such as only 
transmission of the document to further improve opera- 
tion flexibility. 

15 

(6-2) Other services 

The central processing means 9 can provide vari- 
ous services depending on selection by users in addi- 
tion to the services explained above. As already 20 
described, for the selection by a user, various input 
methods may be used corresponding to the appara- 
tuses used. These services are implemented mainly by 
the MAM server also explained above. 

Namely, the central processing means 9 collects zs 
the access from users for each page and notifies the 
popular pages to a user depending on the collection 
result Moreover, the pages opened only for the con- 
stant period, so-called the recommended pages are 
also notified. 30 

In addition, the central processing means 9 
retrieves these pages and presents to a user depending 
on selection by user. On the occasion of retrieval, the 
central processing means 9 retrieves the page which a 
user desires with reference to the keyword input by user 35 
and a plurality of similar words with reference to this 
keyword. Moreover, in this case, the central processing 
means 9 accepts input of these keywords through the 
voice recognition. 

Moreover, the central processing means 9 offers <to 
the various kinds of services, for example, of sports, lit- 
erature and arts corresponding to classification of 
books and retrieves and presents the pages corre- 
sponding to the kind of service by selection by voice or 
operation of corresponding operator. 4s 

In addition, for the input of keyword by voice, it is 
compared with the voice information provided in the 
resource on the Internet, depending on the selection, for 
example by the DP matching method and thereby the 
page which a user desires is notified. so 

When a user instructs retrieval by inputting image 
data and video data from the facsimile apparatus, the 
central processing means 9 compares these data with 
the video information provided on the resource of Inter- 
net, for example, by means of the template matching ss 
and notifies the page which a user desires depending 
on this comparison result. 

Moreover, the central processing means 9 classi- 
fies the information depending on age t sex of user and 
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type of apparatus registered in the user information 
management database and offers the information serv- 
ice in the sequence considered fitted to user. Namely, 
for a male user, for example, since he is assumed to be 
interested in sports, the home pages regarding sports 
are guided through detail classification. On the other 
hand, for a female user, since she is assumed to be 
interested in fashion, the home pages regarding fashion 
are guided through detail classification. These guides 
are executed in common even when information may be 
offered in any type of voice and text. etc. 

(6-3) Charging service 

Fig. 73 and Fig. 74 are flowcharts showing the 
charging service. This charging service is offered by a 
charging system 3 formed of a computer incorporated 
to the server 1, a local service server 33 formed of a 
similar computer and the server 1 (Fig. 69) so that load 
of user may be alleviated and dissatisfaction for connec- 
tion waiting time may also be dissolved. 

That is, the local service server 33 holds the video 
data of commercia! and video data for notifying change 
of service, etc. in unit of sex, age and address of user 
and access time and moreover corresponding to a kind 
of home page. The server 1 offers the data suitable for 
user from above data during the period until the infor- 
mation of the corresponding page can be obtained after 
a user has designated the desired page and moreover 
deposits the charges to an advertiser offering these 
data, in place of depositing the charge to a user, while 
these data are offered. 

Namely, the central processing means 9 is acti- 
vated, when a user shifts to the step SP501 from the 
step S500 and connects the line to the server 1. and 
executes the user identification process in the step 
SP502. Subsequently, the central processing means 9 
shifts to the step SP503 to drive the charging system 
32. In response to this process, the charging system 32 
starts measuring of connection time in the step SP503 
and reads information such as sex, age and address 
from the user information management database 1 3B in 
the step SP504. The central processing means 9 
presents the services for selection to a user in the step 
SP505. 

When a user selects the page to be accessed in the 
step SP506 under this condition, the central processing 
means 9 shifts to the step SP507 to start the access to 
the corresponding page. The charging system 32 loads, 
in the subsequent step SP508 (Fig. 74), loads the infor- 
mation corresponding to the personal information of a 
user obtained in the step SP504 from the local service 
server 33 to offer this information to a user via the 
server 1 . In this case, the charging system 32 offers the 
corresponding information with reference to the current 
time and changes the information to be offered to a user 
depending on the selection previously registered by 
user to the user information management database 1 3B 
or on the selection by user at the time of making access. 
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Thereby, a user can check, in the step SP509, 
changes of commercial and service from this informa- 
tion during the period until the information of the desired 
page can be obtained and thereby a user can dissolve 
the irritated feeling until the connection may be estab- 5 
lished. Particularly when since the corresponding infor- 
mation is supplied with reference to sex and age. etc. of 
a user, he can obtain just interested information to elim- 
inate dissatisfaction of this kind. Namely, in case a male 
user of twenties frequently accesses to the pages w 
regarding automobiles, a commercial of automobiles is 
offered to him. Moreover, depending on the time sched- 
ule, broadcast of car race is served or, depending on the 
region, automobile show, etc. held in this region is 
guided. In addition, when a user selects the service, for 15 
example, for reading the headline of news papers, the 
corresponding service is offered. 

As explained above, when the information of local 
service server 33 is offered, the charging system 32 
starts, in the step SP5 1 0, measurement of time required 20 
for information service. The central processing means 9 
sends a notice, in the step SP51 1 , when the information 
of the page designated by a user is obtained and 
thereby completes transmission of information such as 
commercial and measurement of time for information 25 
service and shifts to the step SP512 to send the infor- 
mation of the desired page to a user. 

Thereby, a user can obtain the information of the 
designated page in the subsequent step SP513. 
Accordingly, a user shifts to the step SP514 to judge 30 
whether access should be completed or not. When 
access is continuously required, a user shifts to the step 
SP506 to wait again by viewing he commercials until the 
information of the desired page can be obtained. On the 
other hand, when access is completed, a charging sys- 35 
tern 32 completes measurement of connection time, in 
the step SP515, depending on the operation by a user, 
be receiving a notice from the central processing means 
9 and thereafter deposits the charge to the advertiser 
and user, in the subsequent step SP51 6, depending on 40 
the connection time of user, information offering time of 
commercials and contents of information served. 
Namely, when a charge-free data is offered during the 
connection waiting time, the charge of this waiting time 
is deposited to a person who has provided such data 45 
(an advertiser in the case of commercial), in place of a 
user. Moreover, when a pay data is served during the 
connection waiting time, the waiting time charge and 
charge of information served are deposited to a person 
who has served such data, in place of a user. In addi- so 
tton, depending on the contract with the advertiser, the 
charge or a part of the charge deposited in accordance 
with the connection time may be deposited to the adver- 
tiser. 

55 

(7) Effect of the Embodiment 

According to the structure explained above, access 
to the Internet can be realized even from a telephone 
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terminal by combining the codes corresponding to the 
operators to be operated at the telephone terminal to 
form the code such as an address required for transmis- 
sion and reception of information. Moreover, in this 
case, with formation of a user information management 
database by combining such codes to uniquely identify 
the terminal and recording of various pieces of informa- 
tion in this database, the data conversion process, data 
transfer process, information service process by voice 
and charging process, etc. corresponding to a type of 
terminals can be executed by effectively using the infor- 
mation of this database and compensating for the infor- 
mation of this database with operations by a user. 
Accordingly the operation flexibility can further be 
improved by easily utilizing the information network of 
this type. 

(8) Other embodiments 

In above embodiment, the ASCII code has been 
converted into the Gaia code by converting character 
code expressed by the hexadecimal number in the 
ASCII code into the decimal number of three digits. The 
present invention is not limited thereto and it is also pos- 
sible, as shown in Fig. 75, that combination of operators 
"0 to 9, * and #" which can be operated on the telephone 
terminal may be only replaced with alphanumerics with 
reference to the conversion table. Namely, in this case, 
alphabet "a" corresponds to operation of operator "01" 
and when a user designates the address 
"abc@eee.hhh.jjj" with address designation in the ordi- 
nary Internet from a telephone terminal, the numerical 
data of "0102031 10505051208080812101010" is input 

Moreover, in above embodiment, various services 
are offered utilizing a user information management 
database for the destination consisting of electronic 
mail termination terminal and access terminal of world 
wide web, but the present invention is not limited thereto 
and it is also possible to structure a database of infor- 
mation origination terminal with the user information 
management database and thereby various services 
are offered using this database. Namely, format of data 
transmitted by a terminal as the information originating 
terminal and language formed of data may be identified 
to provide the services such as data conversion and 
translation, etc. 

Moreover, in the embodiment explained above, the 
area oode of telephone network is used as the coordi- 
nate data for identifying an information originating termi- 
nal or an information destination terminal, but the 
present invention is not limited thereto but a regional 
code corresponding to the mail number can also be 
used. Thereby, services by mail can further be enriched. 

Moreover, in above embodiment, direct access to 
the personal data with the Gaia server using the server 
program is disabled but the present invention is not lim- 
ited thereto and it is also possible that the MAM server 
and Gaia server are constituted from a private compu- 
ter, disabling direct access to the personal data from the 
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Gaia server. 

Moreover, in above embodiment, data format is 
converted when a user makes access to the electronic 
mails, but the present invention is not limited thereto 
and data may be converted, for example, using the time s 
schedule having comparative allowance and data may 
also be converted when data is input. 

Moreover, in above embodiment, the voice signal is 
converted to the voice data of WAV format or ISDN ^i- 
law format, but the present invention is not limited 10 
thereto and the voice data may be generated by adopt- 
ing AU, etc. 

Moreover, in above embodiment, the present inven- 
tion is applied to the information network consisting of 
the Internet, but the present invention is not limited 15 
thereto and the present invention can also be adopted 
to information networks formed in various scales. 

Moreover, in above embodiment, access to the 
information network from a telephone terminal is ena- 
bled by combining the codes corresponding to the oper- 20 
ator to be operated at the telephone terminal to form the 
code such as address required for transmission and 
reception of information. Therefore, access to the infor- 
mation network from a terminal of the simplified struc- 
ture can be realized. 25 

Moreover, in this case, with formation of a user 
information management database and recording of 
various pieces of information of a user to this database 
by combining the codes to uniquely identify the terminal, 
data conversion process, data transfer process, infor- 30 
mation service process by voice and charging process, 
etc. corresponding to the type of terminal can be exe- 
cuted by effectively utilizing information stored in the 
database and thereby the information network of this 
type can be easily used to improve operation flexibility. 35 

Claims 

1. An information processing apparatus connected to 
information network for transmitting and receiving 40 
various pieces of information, comprising: 

means for (3) receiving a code, which is an 
identification code input from one communica- 
tion terminal (4, 5, 6, 1 5) among those of a plu- 46 
rafity of kinds on the same network (2) 
belonging to a first user and i6 formed by com- 
bination of the codes corresponding to opera- 
tors operated at said communication terminal, 
to identify at least one communication terminal so 
of a plurality of kinds on he same network 
belonging to a second user or an information 
originating terminal offering information on the 
network as an access destination; 
means (9) for obtaining an address of the ss 
access destination corresponding to said iden- 
tification code received; and 
means (7) for making communication between 
said address obtained and communication ter- 



minal of the first user. 

2. An information processing apparatus according to 
claim 1, wherein said identification code includes 
an index code which indirectly indicates an address 
of said access destination and 

said apparatus further comprising: 

a retrieval table (13A) storing said identification 
code and address of communication terminal 
belonging to the second user or address of said 
information originating terminal on one to one 
basis; and 

means for comparing said input identification 
code with said retrieval table (13A) to obtain 
address of access destination corresponding to 
said identification code. 

3. An information processing apparatus according to 
daim 2, wherein said identification code is transmit- 
ted through data compression. 

4. An information processing apparatus according to 
claim 2, wherein said index code is formed in the 
hierarchical structure. 

5. An information processing apparatus according to 
claim 1 , wherein said identification code is formed 
of an attribute data indicating a kind of access des- 
tination and a personal data indicating an address 
of access destination. 

6. An information processing apparatus according to 
claim 5, wherein said personal data includes an 
access right information indicating propriety of 
access; and 

said apparatus further comprising: 

means for restricting access to said personal 
data based on said access right information. 

7. An information processing apparatus according to 
claim 6, wherein said personal data any of the elec- 
tronic mail, telephone number of telephone termi- 
nal, facsimile apparatus number and address. 

8. An information processing apparatus according to 
daim 7, wherein an address of corresponding said 
personal data is output in order to mail information 
transmitted to or received from a computer (4). 

9. An information processing apparatus connected to 
information networks for transmitting and receiving 
various pieces of information, comprising: 

means (3) for receiving a code, which is an 
identification code input from one communica- 
tion terminal (4, 5, 6, 15) among those of a plu- 
rality of kinds on the same network (2) 
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belonging to a first user and is formed by com- 
bination of the codes corresponding to opera- 
tors operated at said communication terminal, 
to identify at least one communication terminal 
of a plurality of kinds on the same network 5 
belonging to a second user or an information 
originating terminal offering information on the 
network as an access destination; 
management means (23) for administrating 
individual data indicating incorporation of said 10. 
identification code in correspondence to said 
identification together with a kind of access 
object; and 

control means for controlling communication of 
said information depending on contents admin- 15 
istrated by sad management means (23). 



10. An information processing apparatus according to 
claim 9, wherein said management means (23) 
includes link information instructing link with said 20 
communication terminal (4, 5. 6. 15). 

11. An information processing apparatus according to 
claim 10, wherein said management means (23) 
includes time management information indicating 25 
the schedule of incorporated user of said identifica- 
tion code. 

12. An information processing apparatus according to 
claim 10, wherein said management means (23) 30 
includes information regarding conditions for allow- 
ing the link corresponding to said link information. 

13. An information processing apparatus according to 
claim 12, wherein said management means (23) 35 
includes the conditions for invalidating link together 
with the information regarding conditions for allow- 
ing link. 

14. An information processing apparatus according to to 
claim 9, wherein said means for controlling informa- 
tion communication transfers the information origi- 
nated to the predetermined user depending on 
contents registered to said management means 

(23). 46 

15. An information processing apparatus according to 
claim 14, wherein said means for controlling infor- 
mation communication transfers said information in 
accordance with the address of said information so 
originating terminal. 

16. An information processing apparatus according to 
claim 10, wherein said means for controlling infor- 
mation communication transfers, depending on ss 
said link information, the information originated to 
said second user to the link destination linked to 
said identification code. 



17. An information processing apparatus according to 
daim 1 1 , wherein said means for controlling infor- 
mation communication transfers said information in 
accordance with said time management informa- 
tion. 

18. An information processing apparatus according to 
daim 12, wherein said means for controlling infor- 
mation communication transfers said information in 
accordance with said link permitting conditions and 
said link information. 

19. An information processing apparatus according to 
claim 9, wherein said means for controlling informa- 
tion signal converts said information to be trans- 
ferred in accordance with a kind of said access 
object. 

20. An information processing apparatus connected to 
information networks for transmitting an input infor- 
mation input via a communication terminal, com- 
prising: 

means (3) for receiving a code, which is an 
identification code input from one communica- 
tion terminal (4, 5, 6, 15)among those of a plu- 
rality of kinds on the same network (2) 
belonging to a first user and is formed by com- 
bination of the codes corresponding to opera- 
tors operated at said communication terminal, 
to identify at least one communication terminal 
of a plurality of kinds on the same network 
belonging to a second user 
means (9) for obtaining an address of the 
access destination corresponding to said 
received identification code; 
means for discriminating a type of the commu- 
nication terminal of the access destination from 
said address obtained; and 
means for transmitting, after data conversion, 
said input information corresponding to a type 
of said communication terminal discriminated. 

21. An information processing apparatus according to 
daim 20, wherein said input information is formed 
of a voice signal and said voice signal is transmitted 
after it is converted to the text data through voice 
recognition (10). 

22. An information processing apparatus according to 
daim 21, wherein the image formed by said text 
data is transmitted by image data or video data. 

23. An information processing apparatus according to 
daim 20, wherein said input information is text data 
and said text data is transmitted by a voice signal 
through speech synthesis (1 1). 

24. An information processing apparatus according to 
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claim 20, wherein said input information is a voice 
signal and said voice signal is transmitted after it is 
converted to voice data of the predetermined for- 
mat through the analog-to-digital conversion proc- 
ess. 5 

25. An information processing apparatus according to 
claim 20, wherein said input information is an image 
data input via a facsimile apparatus (6) and said 
image data is transmitted after it is converted to text w 
data by executing character recognition process 
(14) to the image formed by said image data. 

26. An information processing apparatus according to 
claim 25, wherein said text data is transmitted by a 15 
voice signal through the speech synthesis (11). 

27. An information processing apparatus which is con- 
nected to an information network for accumulating 
various pieces of input information inter-related 20 
organically with each other for transmitting and 
receiving said input information between said infor- 
mation storing means and a terminal, comprising: 



28. An information processing apparatus according to 35 
claim 27, wherein said input information is a voice 
signal and said voice signal is transferred after it is 
converted to text data through speech synthesis 
(11). 

40 

29. An information processing apparatus according to 
claim 28, wherein video formed by said text data is 
transmitted by an image data or by video data. 

30. An information processing apparatus according to 45 
claim 27, wherein said input information is text data 
and said text data is transmitted by voice signal 
through speech synthesis. 

31. An information processing apparatus according to so 
claim 27, wherein said input information is formed 

of voice signal and said voice signal is transmitted 
after it is converted to the voice data of the prede- 
termined format through the analog-to-digital con- 
version process. 55 

32. An information processing apparatus according to 
claim 27, wherein said input information is image 
data input via a facsimile apparatus (6) and said 



image data is transmitted after it is converted text 
data by executing the character recognition process 
(14) to the image formed by said image data. 

33. An information processing apparatus according to 
claim 32, wherein said text data is transmitted by 
voice signal through speech synthesis (1 1). 

34. An information processing apparatus being con- 
nected to an information network for transmitting 
and receiving various pieces of information, com- 
prising: 

means for forming the identification code 
required for transmission and reception of said 
information by combining the codes corre- 
sponding to the operators operated on the tele- 
phone terminal (5); and 

means for transmitting said information input 
from the information terminal by adding thereto 
an address code consisting of said identifica- 
tion code. 

35. An information processing apparatus according to 
claim 34, wherein said address code is generated 
by executing voice recognition to the voice signal 
input from a telephone terminal (5). 

36. An information processing apparatus according to 
claim 35, wherein said address code is formed by 
selecting the code previously registered, in accord- 
ance with the voice recognition result. 

37. An information processing apparatus according to 
claim 36, wherein said address code selection is 
executed by selecting the code corresponding to a 
word by recognizing, through voice recognition 
(10), the voice of said word which is previously and 
individually registered by a user. 

38. An information processing apparatus according to 
claim 34, wherein said address code is famed by 
detecting pronunciation of voice corresponding to 
the guide by voice. 

39. An information processing apparatus according to 
claim 34, wherein said address code is famed by 
detecting operation of operator on a telephone ter- 
minal (5) or the terminal having the same operator 
as the telephone terminal (5). 

40. An information processing apparatus according to 
claim 39, wherein said address code is famed by 
detecting said operation of operator corresponding 
to the guide by voice. 

41. An information processing apparatus according to 
daim 34, wherein said address code is famed by 
character recognition (14) of image formed by the 



means for forming the identification code 25 
required for transmission and reception of said 
input information through combination of the 
codes corresponding to the operators operated 
on the telephone terminal (5); and 
means for totally or partially converting said 30 
input information on the occasion of inputting or 
outputting said input information to or from said 
information storing means. 
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image data input from a facsimile apparatus (6). 

42. An information processing apparatus according to 
claim 34, wherein said address code can be set 
again. s 

43. An information processing apparatus being con- 
nected to an information network for transmitting an 
electronic mail input via a terminal, comprising: 

10 

means for forming the identification code 
required for transmission and reception of said 
electronic mail through combination of codes 
corresponding to operator operated on a tele- 
phone terminal (5); and 15 
means (8) for transmitting, through data con- 
version, an input information forming contents 
of said electronic mail in accordance with 
selection of an originating terminal of said elec- 
tronic mail or in accordance with a destination 20 
terminal of said electronic mail. 

44. An information processing apparatus according to 
claim 43, wherein said input information is voice 
signal and said voice signal is transferred after it is 25 
converted to text data by voice recognition (10). 

45. An information processing apparatus according to 
claim 44, wherein an image formed by said text 
data is transmitted by image data or by video data. 30 

46. An information processing apparatus according to 
claim 43, wherein said input information is text data 
and said text data is transmitted by voice signal 
through the speech synthesis (11). 35 

47. An information processing apparatus according to 
claim 43, wherein said input information is voice 
signal and said voice signal is transmitted after it is 
converted to voice data of the predetermined for- 40 
mat by the analog-to-digital conversion process. 

48. An information processing apparatus according to 
claim 43, wherein said input information is formed 

of an image data input via a facsimile apparatus (6) 45 
and said image data is transmitted after it is con- 
verted to text data through character recognition 
process (14) of an image formed by said image 
data. 

so 

49. An information processing apparatus according to 
claim 48, wherein said text data is transmitted by 
voice signal through speech synthesis (11). 

50. An information processing apparatus according to ss 
claim 43, wherein said input information is 
expressed by combination of codes corresponding 

to operator operated on a telephone terminal (5). 
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51. An information processing apparatus according to 
claim 43, wherein said input information is selected 
from the text registered previously in response to 
operation of operator on a telephone terminal (5). 

52. An information processing apparatus according to 
claim 43, wherein said input information is selected 
from the text registered previously in accordance 
with the voice recognition result. 

53. An information processing apparatus according to 
daim 43, wherein the data indicating the time for 
use is added to said input information. 

54. An information processing apparatus according to 
claim 43, wherein the identification data indicating a 
Wnd of input information terminal to said input infor- 
mation. 

55. An information processing apparatus according to 
daim 43, wherein the identification data indicating 
characteristic of voice of an originator to said input 
information. 

56. An information processing apparatus being con- 
nected to an information network for storing various 
pieces of information inter-related organically with 
each other to an information storing means to trans- 
mit or receive said input information between said 
information storing means and a terminal, compris- 
ing: 

means for forming the identification code 
required for transmission and reception of said 
input information by combining the codes cor- 
responding to operator operated on a tele- 
phone terminal: and 

means for adding classification information of 
said input information to said input information 
to be stored in said information storing means. 

57. An information processing apparatus according to 
daim 56, wherein said classification information is 
the data for identifying a kind of input terminal hav- 
ing input said input information. 

58. An information processing apparatus according to 
daim 56, wherein said classification information is 
the identification data indicating characteristic of a 
user having input said input information. 

59. An information processing apparatus according to 
daim 56, wherein said identification data is 
detected by said voice of user. 

60. An information processing apparatus according to 
daim 56, wherein said classification information is 
formed by combination of codes corresponding to 
operators operated on a telephone terminal (5). 
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61. An information processing apparatus according to 
claim 56, wherein characteristic of voice of user is 
utilized for user identification for access to said 
information network (2). 

62. An information processing apparatus according to 
claim 1, wherein user identification is executed by 
checking pronunciation of keyword registered previ- 
ously for the access to said information network. 

63. An information processing apparatus being con- 
nected to an information network for transmitting 
voice signal input via a terminal, comprising: 



64. An information processing apparatus being con- 25 
nected to an information network for storing various 
pieces of information inter-related organically with 
each other to an information storing means for 
transmission and reception of said input information 
between said information storing means and a ter- 30 
minal, comprising: 



65. An information processing apparatus according to 
claim 64, wherein an attribute data indicating char- 4s 
actertstic of a user making access to said informa- 
tion is held in accordance with said identification 
code and said information held separately is 
selected and offered in accordance with said 
attribute data. so 

66. An information processing apparatus being con- 
nected to an information network for originating 
information input via a terminal, comprising: 

55 

means for forming the identification code 
required for transmission and reception of said 
information by combining the codes corre- 
sponding to operator operated on a telephone 



terminal, and 

means for offering said information by voice in 
accordance with sad identification code or 
selection by user. 

67. An information processing apparatus according to 
claim 66, wherein said information is offered by 
voice through the speech synthesis process (11). 

68. An information processing apparatus according to 
claim 66, wherein said information is offered by 
voice by reproducing the contents previously 
recorded. 

69. An information processing apparatus according to 
claim 68, wherein said voice is varied or said voice 
is changed over in accordance with contents of sad 
information or operation by user. 

70. An information processing apparatus according to 
claim 69. wherein said variation of voice is executed 
by changing speed and level of the voice. 

71. An information processing apparatus according to 
claim 69, wherein said voice is once punctuated at 
the space of said information to change the voice 
quality or language in order to vary said voice. 

72. An information processing apparatus according to 
claim 66, wherein said information to be offered is 
notified following the guide by voice. 

73. An information processing apparatus according to 
claim 66, wherein said information to be offered is 
selected for the offering purpose. 

74. An information processing apparatus according to 
claim 73, wherein said information is an electronic 
mail and said selection process is executed with 
reference to the subject of said electronic mail. 

75. An information processing apparatus according to 
claim 73, wherein sad information is an electronic 
mail and said selection process is executed with 
reference to the length of contents. 

76. An information processing apparatus according to 
claim 73, wherein said information is an electronic 
mail and said selection process is executed in 
accordance with inclusion or not inclusion of prede- 
termined characters in the subject. 

77. An information processing apparatus according to 
claim 73, wherein said information is an electronic 
mail and said selection process is executed in 
accordance with inclusion or not inclusion of char- 
acters input or selected by a user in said subject. 

78. An information processing apparatus according to 



means for farming the identification code 15 
required for transmission and reception of said 
voice signal by combining the codes corre- 
sponding to operators operated on a telephone 
terminal; 

means (8) for transmitting said voice signal 20 
through data conversion; and 
means for notifying amount of data after said 
data conversion to a charging system. 



means for forming the identification code 
required for transmission and reception of said 
input information by combining the codes cor- 35 
responding to operators operated on a tele- 
phone terminal, and 

means for offering, in response to the request 
from said terminal, the information held sepa- 
rately to said terminal during access to said 40 
input information stored in said information 
storing means. 
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claim 73, wherein said information is an electronic 
mail and said selection process is executed in 
accordance with inclusion or not inclusion of a part 
of the character group input or selected by a user in 
said subject. s 

79. An information processing apparatus being con- 
nected to an information network (2) to store vari- 
ous pieces of information inter-related organically 
with each other for transmitting and receiving said 10 
information between said information storing 
means (13) and a terminal comprising: 

means for forming the identification code 
required for transmission and reception of said is 
information by combining the codes corre- 
sponding to operators operated on a telephone 
terminal, and 

means for adding, to said information, the con- 
trol code for identifying a part output by the 20 
speech synthesis and a part output by the text 

80. An information processing apparatus according to 
claim 79, wherein said information is selectively 
offered by voice in accordance with said control 25 
code. 

81. An information processing apparatus according to 
claim 80, wherein said information is offered 
through designation by voice. so 

82. An information processing apparatus according to 
claim 79, wherein the headline of said information is 
offered by the speech synthesis of the hierarchical 
structure. 35 

83. An information processing apparatus according to 
claim 79, wherein the headline of said information is 
offered by trie speech synthesis in accordance with 
the frequency of total access. 40 

84. An information processing apparatus according to 
claim 79, wherein the headline of said information is 
offered by the speech synthesis registered for each 
user. 46 

85. An information processing apparatus according to 
claim 79, wherein inter-relation of said information 
is established by link between the words included in 
each information and the other information and said so 
information is offered by voice by varying or chang- 
ing over the voice with said words. 

86. An information processing apparatus according to 
claim 79, wherein access is made to said informa- ss 
Won storing means (13) by the voice recognition 
(10) or character recognition (14) of the address 
data input from a terminal. 



87. An information processing apparatus according to 
claim 86, wherein access destination for said infor- 
mation storing means (13) can be registered previ- 
ously. 

88. An information processing apparatus according to 
claim 79, wherein an audio data is offered in addi- 
tion to said information. 

89. An information processing apparatus according to 
claim 79, wherein said information is offered 
through classification with reference to information 
regarding a user. 

90. An information processing apparatus according to 
claim 89, wherein said information regarding a user 
is obtained from said voice of user. 

91. A communication identification code to be proc- 
essed by an information processing apparatus 
being connected to an information network for 
transmitting and receiving various pieces of infor- 
mation, wherein 

said identification code is input from one com- 
munication terminal (4, 5, 6, 15) among those 
of a plurality of kinds on the same network (2) 
belonging a first user and is formed by combi- 
nation of the codes corresponding to operators 
operated on said communication terminal to 
identify, as the access destination, at least one 
of the communication terminals of a plurality of 
kinds on the same network or an information 
originating terminal offering information on the 
network belonging to a second user; 
an address of the access destination corre- 
sponding to said identification code is obtained 
in said information processing apparatus; and 
communication is executed between said 
address obtained and a communication termi- 
nal as the first user. 

92. An identification code for communication according 
to claim 91, wherein said identification code 
includes an index code indicating indirectly an 
address of said access destination, and 

an address of the access destination corre- 
sponding to said identification code is obtained 
on the basis of a retrieval table (13A) storing, 
on one-to-one basis, said identification code 
and an address of the communication terminal 
or an address of said information originating 
terminal belonging to the second user. 

93. A communication identification code to be proc- 
essed by an information processing apparatus 
being connected to an information network for 
transmitting and receiving various pieces of infor- 



36 




EP0 810 



mation, wherein 

said identification code is input from one com- 
munication terminal (4, 5, 6. 15) among those 
of a plurality of kinds on the same network (2) 5 
belonging a first user and is formed by combi- 
nation of the codes corresponding to operators 
operated on said communication terminal to 
identify, as the access destination, at least one 
of the communication terminals of a plurality of 10 
kinds on the same network or an information 
originating terminal offering information on the 
network belonging to a second user; 
individual data indicating incorporation of said 
identification code is administrated, together is 
with a kind of access object, in said information 
processing apparatus corresponding to said 
identification code, and 

communication of said information is controlled 
in accordance with said individual data corre- 20 
spending to said input identification code. 

94. An information processing method for transmitting 
and receiving various pieces of information through 
connection with an information network, comprising 25 
the steps of: 

receiving the code, as the identification, input 
from one communication terminal (4, 5, 6, 15) 
among those of a plurality of kinds on the same 30 
network (2) belonging to a first user and formed 
of combination of the codes corresponding to 
operators operated on said communication ter- 
minal to identify, as the access destination, at 
least one of said communication terminals of a 35 
plurality of kinds on the same network or an 
information originating terminal offering the 
information on the network; 
obtaining an address of the access destination 
corresponding to said identification code 40 
received, and 

making communication between said address 
obtained and the communication terminal of 
the first user. 

46 

95. An information processing method for transmitting 
and receiving various pieces of information through 
connection with an information network, comprising 
the steps of: 

50 

receiving the code, as the identification, input 
from one communication terminal (4, 5, 6, 15) 
among those of a plurality of kinds on the same 
network (2) belonging to a first user and formed 
of combination of the codes corresponding to ss 
operators operated on said communication ter- 
minal to identify, as the access destination, at 
least one of said communication 
terminals of a plurality of kinds on the same 
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network or an information originating terminal 
offering the information on the network; 
administrating the individual data indicating 
incorporation of said identification code 
together with a kind of access object corre- 
sponding to said identification code; and 
controlling communication of said information 
in accordance with said individual data being 
administrated and kind of said access object. 

96. An information processing method for transmitting 
input information input via a communication termi- 
nal through connection with an information network, 
comprising the steps of: 

receiving the code, as the identification code, 
input from any one communication terminal (4. 
5. 6. 15) among those of a plurality of kinds on 
the same network (2) belonging to a first user 
and formed by combination of the codes corre- 
sponding to operators operated on said com- 
munication terminal to identify, as the access 
destination, at least one communication termi- 
nal among those of a plurality of kinds on the 
same network belonging to a second user; 
obtaining an address of the access destination 
corresponding to said identification code 
received; 

discriminating a kind of the communication ter- 
minal of the access destination from said 
address obtained; and 

transmitting said input information through data 
conversion corresponding to a kind of said 
communication terminal discriminated. 
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